Import EMOJI_DATA from emoji==2.0.0 instead of UNICODE_EMOJI

[calebchiam]

Hey @jfilter, not sure if there's any intentions to upgrade the emoji dependency to v2.0.0, but I looked into it briefly and made the change if you want to integrate it.

[stevefoga]

@jfilter have there been any updates on this? I believe this fixes #24.

[cvzi]

Hi, I am one of the developers of the emoji module. The emoji module also offers a replace_emoji function, which would be a better choice. I think something like this:

def remove_emoji(text):
    return emoji.replace_emoji(text, replace="")

There is another problem here:

clean-text/cleantext/clean.py

Lines 65 to 93 in 692eb4b

	def to_ascii_unicode(text, lang="en", no_emoji=False):
	"""
	Try to represent unicode data in ascii characters similar to what a human
	with a US keyboard would choose.
	Works great for languages of Western origin, worse the farther the language
	gets from Latin-based alphabets. It's based on hand-tuned character mappings
	that also contain ascii approximations for symbols and non-Latin alphabets.
	"""
	# normalize quotes before since this improves transliteration quality
	text = fix_strange_quotes(text)
	if not no_emoji:
	text = demojize(text, use_aliases=True)
	lang = lang.lower()
	# special handling for German text to preserve umlauts
	if lang == "de":
	text = save_replace(text, lang=lang)
	text = unidecode(text)
	# important to remove utility characters
	if lang == "de":
	text = save_replace(text, lang=lang, back=True)
	if not no_emoji:
	text = emojize(text, use_aliases=True)
	return text

The demojize(text, use_aliases=True) and emojize(text, use_aliases=True) were changed, and now with version 2.0.0 it would be demojize(text, language='alias') and emojize(text, language='alias')

[jfilter]

Hey @cvzi, thanks for bringing this up. I will look into this for the next release.