Is this cheating?
 

if both of you agreed to date exclusively and then you caught him/her dating someone else, is that considered as cheating??

Yes, Obviously it's called cheating.

I think it depends that whether he/she dates with someone else at the time both of you agree to date. If not, i think he/she has right to date with anyone else.