Hey Sam - I think it can work if you setup the funnel correctly.
Rather than sending people straight from Facebook to your affiliate offer - I would have a squeeze page with a related giveaway. That way you can catch their email address from the start.
Use the giveaway as a trust builder - then use email marketing to send them to your affiliate offers. That way you're at least getting leads from those FB ads.