@Revertron - agreed. i am also pretty sure that there was a certain element of curiosity to see where this was going.
overall i do believe though, that its safe to assume that the model they tested has zero guard rails, so, inferring (see what i did there?) that this is an issue in the real world might be a bit far fetched. Which then implies it isnt that large of a security problem.
and also, dont forget, open ai wants to ipo in september. they clearly learned their lesson from anthropic (panic sells).
at the end of the day it wasnt even a hacking but rather a cheating incident. so, we might even change the trajectory to train it more morals, e.g. what is good and what is wrong to do.