Yes, you should go for it.
He may also be a shy guy. This may be why he looked away when the both of you made eye contact that one time.
After you coldly replied to him when he greeted you, he may be worried that you don’t like him.
It would be best to talk to him.
You don’t have to get into detail about how you feel about him.
Just be honest about wanting to get to know him better.
This alone could be enough to make him start looking at you as a possible romantic prospect.