Augmentoolkit/lmsys-800ktokens-basicfiltering

This dataset https://huggingface.co/datasets/OpenLeecher/lmsys_chat_1m_clean But with some basic string matching filtering for refusals applied. This should improve the generalist capability of your model at the expense of making it a bit censored, since I didn't get it all. Could use a more sophisticated filtering pipeline for this. I might build a "filter out refusals" pipeline actually. Might take an hour or two.