I'd like to be able to move the ship up/down using keyboard as well (I mean up/down strafe). Also some display of current speed vector would be nice (ie. arrow relative to current ship orientation).

The up/down thing is already possible IoneE... press R or F (up, down).

Press F1 to see default controls.