Discuss Scratch

Miiraaya
Scratcher
11 posts

Filter system for icons

I've seen people trying to break the community guidelines by using inappropriate icons, however I think there should be a system for blocking out the aforementioned (i.e. pictures of faces, 18+ content, e.t.c.) which would make Scratch a more kid-friendly site
TheAnimalKingdom42
Scratcher
1000+ posts

Filter system for icons

How would the filter know when a profile picture was 18+?
starhero5697
Scratcher
1000+ posts

Filter system for icons

Just report the profile pictures.
Miiraaya
Scratcher
11 posts

Filter system for icons

starhero5697 wrote:

Just report the profile pictures.

Agreed, yet people can just put a new one of the same thing up
starhero5697
Scratcher
1000+ posts

Filter system for icons

Miiraaya wrote:

Agreed, yet people can just put a new one of the same thing up
Then report them again, if they do it repeatedly, they could face a bigger punishment.
k0d3rrr
Scratcher
1000+ posts

Filter system for icons

TheAnimalKingdom42 wrote:

How would the filter know when a profile picture was 18+?
Yeah. And even then, how accurate would the filter be?
It might censor a completely innocent PFP, while it might allow a completely inappropriate PFP.
Miiraaya
Scratcher
11 posts

Filter system for icons

TheAnimalKingdom42 wrote:

How would the filter know when a profile picture was 18+?

It would probably know by using a few telltale signs, so the ST can block the icon being used
starhero5697
Scratcher
1000+ posts

Filter system for icons

Miiraaya wrote:

TheAnimalKingdom42 wrote:

How would the filter know when a profile picture was 18+?
It would probably know by using a few telltale signs, so the ST can block the icon being used
What are the telltale signs? How would the filter work?
TheAnimalKingdom42
Scratcher
1000+ posts

Filter system for icons

Miiraaya wrote:

TheAnimalKingdom42 wrote:

How would the filter know when a profile picture was 18+?

It would probably know by using a few telltale signs, so the ST can block the icon being used
What telltale signs could AI determine?
Also, AI can recognize faces, but what if someone wanted to make their profile picture a famous person or a movie character? I've fooled many different face recognition AIs with my art. That would happen in this case, too, resulting in many false positives.
Tunde123
Scratcher
1000+ posts

Filter system for icons

starhero5697 wrote:

Miiraaya wrote:

Agreed, yet people can just put a new one of the same thing up
Then report them again, if they do it repeatedly, they could face a bigger punishment.
Yeah but the ST won't take immediate action against the user with the inappropriate profile picture. If there were multiple reports, the ST will see it at some point.

As for the suggestion, this sounds like a good idea but there are some problems.
1. How would the filter detect profile pictures?
- What I meant was, what would the filter detect in the profile picture?

2. There will be a lot of false positives.

Miiraaya wrote:

(i.e. pictures of faces, 18+ content, e.t.c.)
If it filters pictures of faces, Griffpatch would have to change his profile picture because it has his face in it. In fact, some faces may not be real, but could be detected by the filter.
Miiraaya
Scratcher
11 posts

Filter system for icons

Miiraaya wrote:

(i.e. pictures of faces, 18+ content, e.t.c.)
If it filters pictures of faces, Griffpatch would have to change his profile picture because it has his face in it. In fact, some faces may not be real, but could be detected by the filter.

When I said pictures of faces, I meant photographs ^^
Tunde123
Scratcher
1000+ posts

Filter system for icons

Miiraaya wrote:

Tunde123 wrote:

Miiraaya wrote:

(i.e. pictures of faces, 18+ content, e.t.c.)
If it filters pictures of faces, Griffpatch would have to change his profile picture because it has his face in it. In fact, some faces may not be real, but could be detected by the filter.

When I said pictures of faces, I meant photographs ^^
Even if it is photographs, some people can change the look of a face using Photoshop.

Last edited by Tunde123 (May 23, 2022 12:39:25)

arpa76
Scratcher
100+ posts

Filter system for icons

Nearly any AI can be fooled, and with the 512x512 resolution max of Scratch pfps it's even harder to figure out if an image would be marked inappropriate, and with faces it's even harder to moderate (a drawing of a face would get moderated, an image that slightly resembles a face would get moderated, etc.)

Reporting people would be (and is) much more effective than any AI would be on Scratch.
k0d3rrr
Scratcher
1000+ posts

Filter system for icons

stuppypanda wrote:

Nearly any AI can be fooled, and with the 512x512 resolution max of Scratch pfps it's even harder to figure out if an image would be marked inappropriate, and with faces it's even harder to moderate (a drawing of a face would get moderated, an image that slightly resembles a face would get moderated, etc.)

Reporting people would be (and is) much more effective than any AI would be on Scratch.
That's correct.

Imagine, for example, someone set their PFP to the famous picture of the crater that looks like a face:

Because the AI for the filter isn't smart enough to recognise that that's not a face, but rather a crater that looks like a face, the filter would remove that PFP, even though it isn't revealing anyone's face.
RED-001-alt
Scratcher
1000+ posts

Filter system for icons

TheAnimalKingdom42 wrote:

https://u.cubeupload.com/bebegriggs_/why.png
What's the URL for this??
TheAnimalKingdom42
Scratcher
1000+ posts

Filter system for icons

RED-001-alt wrote:

TheAnimalKingdom42 wrote:

https://u.cubeupload.com/bebegriggs_/why.png
What's the URL for this??
Please don't go off-topic. That's in my signature. I don't know if Quora links are allowed but you can look it up.

Anyways, OP, you said this would detect faces, as well as other “telltale signs”. What “telltale signs” are you referring to? How would the AI recognize it?
RED-001-alt
Scratcher
1000+ posts

Filter system for icons

its real…
Anyway, no support, it would be too complicated, and if the filter bot doesn't even work half the time on Scratch then there for sure isn't gonna be any face detection or any kind of image detection at all.

Last edited by RED-001-alt (May 23, 2022 19:05:28)

NecroAnvil
Scratcher
31 posts

Filter system for icons

If this were to be implemented, people would try to find out how it works and when they do, try to workaround it.
CaIIMeHoid
Scratcher
6 posts

Filter system for icons

TheAnimalKingdom42 wrote:

How would the filter know when a profile picture was 18+?
I'd imagine something like this. Your text to link here…
Alicorn468
Scratcher
22 posts

Filter system for icons

Miiraaya wrote:

I've seen people trying to break the community guidelines by using inappropriate icons, however I think there should be a system for blocking out the aforementioned (i.e. pictures of faces, 18+ content, e.t.c.) which would make Scratch a more kid-friendly site

Scratch could use an AI that could get smarter by each pfp that gets into scratch but idk

Powered by DjangoBB