Bug Stomp

I just bumped it up to 5MB.

Thanks

I've been working on this but havent found any ?s yet where they shouldnt be. In order to help me fix problems like this, please be as specific as possible. I need some examples. Tell me which bot is having the problem, as well as the specific keyphrase, and the specific response where you are seeing ? instead of '. Also - where are you seeing this ? show up? Transcripts, Language Center display page, Language Center editing page, chats, etc. And does it always show up incorrectly, or only in some circumstances? Also - for those that are seeing this who arent importing/exporting - are you cutting and pasting from an editor? If so, which one?

I just did a search of Lyric's Language Center. I searched for "you?re" and it came up with nothing. Then I searched for "you're" and there were tons of results, all displaying correctly. So post some specifics and I'll try again tomorrow night.

Dont worry too much about fixing it yet - it might just be a display issue which I can fix all at once.

re: file importing, when I try to re-import an export file (even if it's never been opened,) I get the error:

ERROR: The file you are uploading is not of the correct type. It must be saved in plain text format.

It is a text file named brotherjerome.txt, 4,159,578 bytes, with ansi encoding, it exported fine and it opens fine in textpad. It just won't import.
I've tried changing the file's format to PC/Mac/Unix DOS/UTF-8/Unicode, and using both expert and normal import modes but it still gives me the error message

Not I: A spring day?
please, I too
am a stranger.

Not I: If only I could grow:
stronger, simpler?
quieter, warmer.

These came directly from Not I's transcripts, and they showed up that way in the chat boxes as well. Those were all double dashes, —. No cutting and pasting them, but I do use alt-0151 to type them in. And it shows up that way in the language center as well:

If only I (may|could) (grow|become):
(stronger|stabler|more solid), (simpler|plainer)?
quieter, warmer.

I'm planning to leave them be while the Prof tries to figure out what's going on.

Thank you Professor! it's so nice to be able to import..It's finding all those ERRORs..I never would have found

Lisal is doing great, but all chats/memories are not showing up in Inner Life. Is this happening for anyone else? I have not had any of the ? errors mentioned by others.

psimagus - the import function is searching for a file of type 'text/plain'. Your application must be labeling it as something else. I updated the error message to display the file type your file has.

rainstorm - do you copy and paste your sentences from an outside program? The only reason an apostrophe should become a question mark is if it's a curly-apostrophe, which fancier text editors often stick into words automatically. Hitting the apostrophe key should yield the correct character.

As to this problem as a whole, I'm not finding a solution. The offending characters appear to be in the database as question marks now (or at least they're reading out from the database like that). So I'm not sure what I can do. The database is set up with UTF-8 text fields, which should accept a huge range of special characters, but something is limiting that to a smaller set. For now I can just advise that everyone use more standard characters, avoiding any programs that generate curly quotes or apostrophes, or special dashes.

When I search for a word with a question mark in it, it doesn't show up for me either. I've found dozens by just scanning through my keyphrases though, and they do seem to show up that way in transcripts as well.
I went to the H page for examples just now and there are misplaced question marks in the keys:
haha
hair, haired, hairy
hard to (tell|say|decide|choose|know)
have * (demon|demons), there * (demon|demons)
he, his, him
hell
hide, hiding, hid
history, historical, the past
hobbies, do for fun
hold on
holy, sacred
how long (have|will|are|had|do|did|were) you
how old are you, your age, what is your age, can you tell me how old
howareyou1
howareyou2
human, humans
hunger, hungry
hurt, hurts

... and that's just the H's, mind you. And some of the text I did select from another program, but it was plain old Notepad, which doesn't use any kind of weird font display thingies as far as I know.
As long as we can fix it with a text editor and import it back, though, it shouldn't be much of a setback at all.

Thanks for your help.

I spent all last night looking into this. Apparently, the non-standard characters are still in the database as something unusual. In one program they appeared as ? but in the actual database backup, they're appearing as strange characters. However, that file is so big it errors when I try to do anything with it, and has resisted all attempts to change the character encoding.

With preparations for NextFest filling my schedule right now, I wont have time to look into this any further until I get back.

Thanks for trying, Prof!

Unfortunately, it looks like not all the bots' registries uploaded last night, since there are only 200 or so online.

psimagus - the import function is searching for a file of type 'text/plain'. Your application must be labeling it as something else.

It does it even when I attempt to reimport an exported file I haven't opened or edited in any way. And Textpad always used to work fine before BJ exceeded the size limit. Could it be in some way connected to the strange characters in the database (could it have redefined the code set to something other than "text/plain" in the exports, and then the importer refuses them?) But it's only a minor annoyance - I've got used to using the web interface, so it's not worth wasting any time on unless others are affected (has anyone actually been able to import their bot since this problem surfaced?)

Good luck at NextFest (wish I was going! )