You should seek legal advice, but based on my own research, when he gave you his credit card to use, he was actually violating his own agreement with the credit card company, which states that he is the owner of the card, and responsible for paying the balance. If he wanted to share the card, he should have added you as an “authorized user.”
