Edit History (Oldest to Newest)
Version: 1
Fields Changed (Original)
Updated
Content

"More of an issue with mortals than with 'ideal-agents' or, I suspect, gods.  Or maybe it's just the Lawful ones, I don't know.  But an 'ideal-agent', even a 'bounded ideal-agent', if It considers the theory after seeing the evidence, won't be at all influenced by having seen the evidence, in what predictions It says the theory makes.  So while It might not even bother to invent some wrong theory, if the evidence contradicts it, it would nonetheless be the case, that if you asked It what the evidence said about that wrong theory, It would know the correct answer there."

"I nonetheless claim that if you hook up to the Keltham-environment a random input generator that picks three random numbers each independently between negative one thousand and positive one thousand, and let a god passively observe that, the god will learn less than a mortal who decides which inputs to give the Keltham-environment.  Well, maybe not with the 'timing side-channel' information added, but definitely without that timing information."

"Furthermore, I claim that this mysterious superiority of the mortal, over the god, has to do with a process which includes the mortal predicting things in advance of seeing them, nor may it be done without the mortal making those predictions."

Version: 2
Fields Changed Content
Updated
Content

"More of an issue with mortals than with 'ideal-agents' or, I suspect, gods.  Or maybe it's just the Lawful ones, I don't know.  But an 'ideal-agent', even a 'bounded ideal-agent', if It considers the theory after seeing the evidence, won't be at all influenced by having seen the evidence, in what predictions It says the theory makes.  So while It might not even bother to invent some wrong theory, if the evidence contradicts it, it would nonetheless be the case, that if you asked It what the evidence said about that wrong theory, It would know the correct answer there."

"I nonetheless claim that if you hook up to the Keltham-environment a random input generator that picks three random numbers each independently between negative one thousand and positive one thousand, and let a god passively observe that, the god will learn less than a mortal playing the game with Keltham.  Well, maybe not with the 'timing side-channel' information added, but definitely without that timing information."

"Furthermore, I claim that this mysterious superiority of the mortal, over the god, has to do with a process which includes the mortal predicting things in advance of seeing them, nor may it be done without the mortal making those predictions."