To disable search engine crawling of specific extension files (txt, csv, etc) use:

User-agent: *
Disallow: /*.txt$
Allow: /