... just as a hit:

The Termius iOS APP has a nice solution regarding the cursor navigationen within a shell.

You just have to swipe up and down / left and right on the terminal screen.

And by the way double-tab on the screen is "TAB" e.g. for command completion.

But I don't know if this fits into your overall UI/UX concept.