Using Anytype 0.18.28 on Windows 10, using backspace to erase an inline code block and then typing replacement text has this undesirable result, with the HTML for display suddenly becoming part of your page text:
It only happens if you backspace to the exact point at which the inline code block began/begins; going back one space further, or not backspacing the entire thing, it behaves normally.