Am I just insecure or is there something to this?

I'm a 23 yo blk female. I've been having an off again on again relationship with a white male. We have a lot in common and I enjoy being with him, but I'm the first black girl he's dated. My fear is that I'm just his taste of the "forbidden fruit" before he settles down with someone of his own race. he's admitted to me that his parents most likely wouldnt approve if I was the one coming to dinner and that he'd probably date a white girl if he wasnt seeing me, but says that race doesnt matter to him. Should I believe him or get out now before I get my feelings hurt?