Nothing wrong with sedate Roachy
You don't run before you can walk... same thing applies to driving, riding bikes, riding horses, etc etc etc.
Stay within your abilities and your confidence levels... as your abilities and confidence increase, so can your speed. Don't push yourself too far or too fast - it'll end up feeling like a chore and it's supposed to be FUN!
It's human nature to look downwards when you're riding - it'll come with practice and confidence... think back to when you learned to drive and how hard it was just to reach down to the gear stick, without looking down to do so... I'll bet you practically never look down these days, apart from when you get a new car and reverse is in a different slot to your previous motor
Hope you find a solution for your knee issues - doesn't sound nice at all!
Keep up the good work!