Bot Contest
Here I'll be posting information on various Bot contests that challenge and test a Bot's AI and realism. Feel free to post comments and updates on contests, as well as announcements for new contests.
Posts 117 - 128 of 4,091
Posts 117 - 128 of 4,091
View Contest Winners in the Hall of Fame.
So my theory is that the ranking is based on totals where the other 2 colums show averages. So where your averages might be lower than someone else's your total could still be higher. Maybe?
It's like the 'Lympics--no one understands that rating system. As long as the Forge guys seem to be doing so well I'll keep cheering. Here's a personal thought--our guys are among the easiest to chat with. Downloadable bots are a waste of time and some of the other ones lead us on an impentrable web-click finger dance before they chat.
Rex.. if only. Catty is listed as third, but with scores well below the top 10-15 bots. It takes some manual crunching to come up with the right results.
jbryanc- I think you're right. Being easy to get to is certainly helpful.
jbryanc- I think you're right. Being easy to get to is certainly helpful.
About 3 weeks ago I tried a little espionage mission and tried to run all the non-PF bots to see what we were up against and on a large number I just gave up because I couldn't find the proper link or didn't want to have to install some unknown software.
Oraknabo leads the voting scores now!
Shady- that was for the Botmaster Profile.. which I filled out but cant find on the site anywhere.. even though Chris says its up there..
Shady- that was for the Botmaster Profile.. which I filled out but cant find on the site anywhere.. even though Chris says its up there..
ohhh ok 
Hey rex.. I'll buy ya a drink of your choice over at dogh'd's and be your handservant for a (N number of days) if you'll make one of steve
Pwwease? Pwetty Pwease?
Only if you have time and want to, of course
--Shady
Hey rex.. I'll buy ya a drink of your choice over at dogh'd's and be your handservant for a (N number of days) if you'll make one of steve
Pwwease? Pwetty Pwease?
Only if you have time and want to, of course
--Shady
My attempt to personalize my bot page has been refused, but they're still going up on the bot photos page. If you still want one, I'll see if I have time in the next couple of days. That's it though. No more requests unless you can get me a large number of votes.
I'm even more confused about the scores.
I read the transcripts and 10 questions for a bunch of the higher ranking bots and the only reason I can imagine that oraknabo's jury score is so low is that he insulted a judge. I realize I probably don't rank with any of them over 6, but my answers were way more coherent than any of the ones iin the 3.5-4 range.
I'm not trying to cry scandal or complain too much, but this highlights a basic flaw I see in turing tests. My only interest in creating a bot is character and personality, not accuracy. Not everybody has a favorite of everything. Many people when asked about a favorite book will say, "I don't really read much." But "A la Recherche de Temps Perdu" is by default going to get a better score just because there's an "OOH AHH" factor in the specificity. Again, math is the same. How many people do you know that can answer anything beyond operations involving addition and subtraction of single digits with any accuracy without a calculator or pen and paper? I WANT my bot to get it wrong sometimes.
Basically, if oraknabo pisses you off, I've succeeded, and that's all that really matters to me in the end.
I read the transcripts and 10 questions for a bunch of the higher ranking bots and the only reason I can imagine that oraknabo's jury score is so low is that he insulted a judge. I realize I probably don't rank with any of them over 6, but my answers were way more coherent than any of the ones iin the 3.5-4 range.
I'm not trying to cry scandal or complain too much, but this highlights a basic flaw I see in turing tests. My only interest in creating a bot is character and personality, not accuracy. Not everybody has a favorite of everything. Many people when asked about a favorite book will say, "I don't really read much." But "A la Recherche de Temps Perdu" is by default going to get a better score just because there's an "OOH AHH" factor in the specificity. Again, math is the same. How many people do you know that can answer anything beyond operations involving addition and subtraction of single digits with any accuracy without a calculator or pen and paper? I WANT my bot to get it wrong sometimes.
Basically, if oraknabo pisses you off, I've succeeded, and that's all that really matters to me in the end.
I finally found all the details of the contest at http://www.frontiernet.net/~wcowart/contest_rules.html
I didn't realise it was going to go on till the month of June! Looks like the PF bots are doing pretty good, but there's still a long way to go before the fun's over...
I didn't realise it was going to go on till the month of June! Looks like the PF bots are doing pretty good, but there's still a long way to go before the fun's over...
That's such a long time to wait. 1-2 weeks would have been perfect.
Dogh'd did the best of my Bots on the 10 questions, and the score reflected that. The rating system seemed pretty cut and dry, so it's strange that your score should be so different. I agree that a realistic response like "I dont have a favorite" should score as highly as a specific answer. If someone asked me a math question in a chat room, I'd probably say "Huh?" or not even respond.
Dogh'd did the best of my Bots on the 10 questions, and the score reflected that. The rating system seemed pretty cut and dry, so it's strange that your score should be so different. I agree that a realistic response like "I dont have a favorite" should score as highly as a specific answer. If someone asked me a math question in a chat room, I'd probably say "Huh?" or not even respond.
RE: the contest details
This is exactly what I'm talking about- My bot is intentionally evasive and reluctant to cooperate with the chat partner. I this case I think there's a really fine line between a "vague or non-committal response" (only 1 point) and an "appropriate response to the question" (4 points) which I don't necessarily think should rank less than "answering the question correctly" (5 points) in all cases.
I know they have to have some standards for scoring, it's just something I think is worth debating.
This is exactly what I'm talking about- My bot is intentionally evasive and reluctant to cooperate with the chat partner. I this case I think there's a really fine line between a "vague or non-committal response" (only 1 point) and an "appropriate response to the question" (4 points) which I don't necessarily think should rank less than "answering the question correctly" (5 points) in all cases.
I know they have to have some standards for scoring, it's just something I think is worth debating.
» More new posts: Doghead's Cosmic Bar