What should i do now?

talk to him about it and if you really like him then go for it dont care sooo much about other people, just make sure you dont care so much about him being with your brother, i think you should go for it, what is there to lose??? live life and just go for it, whats the worst that could happen?? it seems like he likes you!!!