No it’s not. Even if you only have that problem 1% of the time (which is optimistic) you have a real problem when you do.
I appreciate the fact that you have good intentions here but it seems like you haven’t really thought this through. As you’ve mentioned, issuers have an incentive to reduce fraud so if this was a good idea, it would have been done already, it’s not hard to implement.