Discuss Scratch

scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

Image

Within sb3 files, there are assets (png and svg images, wav or mp3 sounds) and a project.json file containing all of the project's sprite names, code data, list / variable data etc. If an sb3 file is opened through zip decompression, all of these files can be seen. If the project.json is over 5Mb in size, it cannot be uploaded to the scratch website but it can be saved locally.

I think that the current limit of 5Mb in size for the project.json is far too low since the assets have an individual size limit of 10Mb which is much larger.

I have developed two very large projects which have both reached the 5Mb project.json limit. I also occasionally find other projects on the website which have reached the 5Mb project.json limit.

Projects that reach the 5Mb json limit also become difficult to remix / modify by other users since they will be unable to upload remixes because a small number of new features will bring the json size too high and their remix can't be saved or shared. Additionally, users are forced to make the code harder to read in order to minimise its overall size which makes it harder for others to read what the code does and learn from it.

Since large assets of 10Mb in size have a much more significant impact on overall project sb3 size, I think that increasing the project.json limit from 5Mb to something like 10Mb or 15Mb would have very little negative impact on the platform as a whole and will have a very positive overall impact from the larger projects people will be able to create and share.

Last edited by scratchfan321 (June 9, 2024 12:24:13)

BigNate469
Scratcher
1000+ posts

The 5Mb project.json limit should be increased

But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.

Scratch is a nonprofit, they don't want to pay for any more storage than they have to.
scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

BigNate469 wrote:

But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.

Scratch is a nonprofit, they don't want to pay for any more storage than they have to.

The project you found that was 1.5Gb in size must have had many assets (large sound files / music most likely) which caused it to build up to 1.5Gb. The 10Mb individual asset limit can be left as is. The project.json is what stores all of the code blocks, list data etc and has a current limit of 5Mb in size. Increasing the project.json size from 5Mb to 10Mb will not have an insignificant impact on the overall project size and would not lead to an increase to 3Gb. There could be a new limit added in order to save storage space while having little negative effect on users (Such as 200Mb compressed sb3 size total)
IndexErrorException
Scratcher
500+ posts

The 5Mb project.json limit should be increased

It's actually 5 MiB of storage, I figured that out while trying to pack as much data into a project as possible. I was going for 10 million digits of PI stored in a project, and I found I needed almost exactly 5 MiB to store it! I did make it work but it's very slow as it uses arbitrary precision ints.

I support it being increased to 10 MiB.

Last edited by IndexErrorException (May 23, 2024 22:32:41)

scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

bump #1

Last edited by scratchfan321 (June 8, 2024 17:31:02)

scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

IndexErrorException wrote:

It's actually 5 MiB of storage, I figured that out while trying to pack as much data into a project as possible. I was going for 10 million digits of PI stored in a project, and I found I needed almost exactly 5 MiB to store it! I did make it work but it's very slow as it uses arbitrary precision ints.

I support it being increased to 10 MiB.
You might be able to store digits of pi encoded in images (4 pixels of black and white encoding each digit for example) then scan them when the project loads and put the values into lists
banana439monkey
Scratcher
1000+ posts

The 5Mb project.json limit should be increased

BigNate469 wrote:

(#2)
But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.

Scratch is a nonprofit, they don't want to pay for any more storage than they have to.

???????????????????????????????????????

Banana
julmik6478
Scratcher
500+ posts

The 5Mb project.json limit should be increased

Possible that electramod has another limit.

Last edited by julmik6478 (May 25, 2024 11:27:20)

scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

bump #2

Last edited by scratchfan321 (June 8, 2024 17:31:14)

GlitchedThrough
New Scratcher
1000+ posts

The 5Mb project.json limit should be increased

BigNate469 wrote:

But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.

Scratch is a nonprofit, they don't want to pay for any more storage than they have to.
You can save a project of us to 712 GB online, I believe.
If someone wanted to data hoard with Scratch, they already could. This just makes more complex programs easier to implement.
BigNate469
Scratcher
1000+ posts

The 5Mb project.json limit should be increased

scratchfan321 wrote:

BigNate469 wrote:

But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.

Scratch is a nonprofit, they don't want to pay for any more storage than they have to.

The project you found that was 1.5Gb in size must have had many assets (large sound files / music most likely) which caused it to build up to 1.5Gb. The 10Mb individual asset limit can be left as is. The project.json is what stores all of the code blocks, list data etc and has a current limit of 5Mb in size. Increasing the project.json size from 5Mb to 10Mb will not have an insignificant impact on the overall project size and would not lead to an increase to 3Gb. There could be a new limit added in order to save storage space while having little negative effect on users (Such as 200Mb compressed sb3 size total)
Assets are linked to their respective sprites in the project.json.

GlitchedThrough wrote:

BigNate469 wrote:

But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.

Scratch is a nonprofit, they don't want to pay for any more storage than they have to.
You can save a project of us to 712 GB online, I believe.
If someone wanted to data hoard with Scratch, they already could. This just makes more complex programs easier to implement.
Wow…
Still could theoretically increase to 1424 gigabytes.
scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

bump #3

Last edited by scratchfan321 (June 8, 2024 17:31:21)

TheEpikGamer211
Scratcher
1000+ posts

The 5Mb project.json limit should be increased

julmik6478 wrote:

Possible that electramod has another limit.
I'm pretty sure you cant mention off-site links, you don't know that might be a Trojan!
scratchcode1_2_3
Scratcher
1000+ posts

The 5Mb project.json limit should be increased

TheEpikGamer211 wrote:

(#13)

julmik6478 wrote:

Possible that electramod has another limit.
I'm pretty sure you cant mention off-site links, you don't know that might be a Trojan!
you can unless it's a browser extension or inappropiate app or unmoderated messaging apps (anything that breaks the guidelines really)

edit:

lol

Last edited by scratchcode1_2_3 (May 29, 2024 22:35:51)

GlitchedThrough
New Scratcher
1000+ posts

The 5Mb project.json limit should be increased

TheEpikGamer211 wrote:

julmik6478 wrote:

Possible that electramod has another limit.
I'm pretty sure you cant mention off-site links, you don't know that might be a Trojan!
Scratch might be a trojan as well!
You may mention any link, as long as the contents follow the Scratch CG
scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

bump #4

Last edited by scratchfan321 (June 8, 2024 17:31:29)

scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

bump #5

Last edited by scratchfan321 (June 8, 2024 17:31:40)

scratchfan321
Scratcher
100+ posts

The 5Mb project.json limit should be increased

bump #6, I really think this would be a useful change

Last edited by scratchfan321 (June 8, 2024 17:31:50)

ajskateboarder
Scratcher
1000+ posts

The 5Mb project.json limit should be increased

BigNate469 wrote:

But if it was 10MB, then people could easily create projects several gigabytes in size (they already can), but they could make really, really large projects. I've seen a project that was 1.5 gigabytes, since doubling the project.json size effectively doubles the maximum project size, this would increase to 3 gigabytes.
A 1.5 GB project would include the JSON and all of its assets. Adding 5 extra MBs would add comparatively nothing to the final project size. Scratch could also apply extra compression to the JSON if they don't already (which I'm hoping they already do)
scratch7000000
Scratcher
100+ posts

The 5Mb project.json limit should be increased

Agreed.

Powered by DjangoBB