LLMs are built that way, with prompting this behavior can certainly be achieved. It's not going to work oerfectly and jailbreaks will still be possible, but not so easy.