pick_unique_sentence

pick_unique_sentence(text)

Most webscrapped data contains duplicated sentence. This function could retrieve unique ones.

Parameters

text: str Text selected to apply transformation.

keyword: str Word to search within the phrase.

Examples:

sentence="I thank doctors
Doctors are working very hard
in this pandemic situation
I thank doctors"
pick_unique_sentence(sentence)
    >>> ['Doctors are working very hard in this
pandemic situation', 'I thank doctors']