Matte top coat

I just started using the matte clear top coat on top of the chalked paint and have had the same issue on two seperate projects.  After I apply the top coat and it has started to dry, parts are very streaky,almost see through and looks like the top top coat has actually taken off the chalked paint.  But it didn't do it to the whole thing, just some spots.  I followed the directions exactly and gave each coat more than enough time to dry.

So frustrating!