pick_unique_sentence
pick_unique_sentence(text)
Most webscrapped data contains duplicated sentence. This function could retrieve unique ones.
Parameters
text: str Text selected to apply transformation.
keyword: str Word to search within the phrase.
Examples:
sentence="I thank doctors
Doctors are working very hard
in this pandemic situation
I thank doctors"
pick_unique_sentence(sentence)
>>> ['Doctors are working very hard in this
pandemic situation', 'I thank doctors']