You are viewing a single comment's thread from:

RE: Who Am I? History Mystery Challenge - Application for Steemit Challenge Season 24

in Steem Dev2 months ago

Interesting idea. Really need to see it in action to determine how AI-resistant it will be.

The MasterQuizMaster @the-gorilla has big buckets of experience on this now from his ongoing Steem Quiz.

Would be interesting to know whether he thinks this would stand up against the AI enthusiasts...

Sort:  

I am waiting for your response. I don't want to finish the project and then find it is not useful. This is my main idea: I need to make sure the idea is good before I finish the game.
I hope sharing this idea helps you think about it! I would really like to hear what @the-gorilla thinks because he has a lot of experience with the Steem Quiz. His thoughts could help me know what to do next.
Also, if the idea is accepted, I will search for users to join the team and share the history stories and quizzes from the admin dashboard

Is there a "manual" version that you could trial first? Even if it's slightly stripped back, it might highlight some challenges / solutions that you could save you having to rework some code.

AI is annoyingly good at identifying people from extremely limited information. I've rejected far more questions than I've asked thanks to the likes of ChatGPT! At the same time, it's great when ChatGPT confidently gives the wrong answer 😆

If that's possible, you could trial it as one of the Steemit Quiz Questions - just reply to the Quiz Master Question Tracker, with an appropriate question number and see how we get on.


With regards to people cheating through multiple accounts - a reputation of 60 probably won't help too much. I'm constantly catching people who have been reward farming with multiple accounts, some from as early as 2017. Since you're developing a custom web app, you could also capture all of the device, browser, etc. details which should allow you to identify duplicate / repeat devices.

How would the screen recording work? Presumably you wouldn't be recording a user's entire desktop?

I saw the questions in your quiz and read the correct answers. I tried to get the correct answer using AI, and it worked. The AI model has improved significantly; it now knows how to reason and think deeply, including using Chain-of-Thought (CoT) prompting.
We know we can't stop AI 100% for cheating. My idea is to provide easy texts about historical figures that anyone can read and use to answer quizzes, rather than making it troublesome for them. For example, if I have an easy exam, why would I need AI? In STEM learning, it’s important for users to truly learn. Helping users learn about new, famous historical figures , like through reading books, which is becoming less common these days, would be beneficial.
My approach to limiting AI is as follows: I won’t just ask for the answer but also for the line where the question is found, similar to what is shown in an image. The AI won’t provide the lines unless the user specifies what each line means. I believe that if the user reads the text, it will be easier to understand.
The recorded video will only capture the current quiz window. The user will choose what they want to record, and I only need a recording of the quiz window to understand the user’s behavior.
To prevent cheating through multiple accounts, as I mentioned in my blog, there will be many question in the database, and they will be provided randomly to each user. I can identify the agent from the header request, but that can be easily changed.
I can provide a demo when it’s possible.

image.png

Thank you for the input @the-gorilla.

At least one of you appreciated it 😆

hahah merci xD

Greetings, dear @steemcurator01. We invite you to read our post about the community, "Community Purpose." We hope you'll be able to read it. Thank you!

https://steemit.com/community-purpose/@commpro/concurso-unete-e-invita