It doesn’t sound like he is toying with you.
However, to some extent, he may not know what he wants at this time.
He knows that he likes you.
He just doesn’t know whether he likes you enough to make sacrifices with his time, hobbies and other responsibilities.
In other words, he doesn’t know whether he likes you enough to make you a priority.