Skip to content

Added pre processed version 1.0 to clean up data set and produce a n… #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Added pre processed version 1.0 to clean up data set and produce a n… #3

wants to merge 1 commit into from

Conversation

@shivanshuk
Copy link
Contributor

@shivanshuk shivanshuk commented May 3, 2020

Added some part from Milestone 1:

  • Reading the data set
  • Creating a master regex as per the data set
  • removing unwanted data from the dataset
  • replacing the unwanted data as per regex
  • cleansing the data set
  • total 8500 * 4 shape gathered and converted
  • replaced all junky characters, emails, body text, cid images etc from data set
  • saved processed data v1.0 under the datasets folder.

@shivanshuk shivanshuk marked this pull request as ready for review May 3, 2020 19:18
@shivanshuk
Copy link
Contributor Author

shivanshuk commented May 3, 2020

@rgnanas
@SrikanthEnuguru
Please check and review the same

@shivanshuk shivanshuk changed the title Added pre procession version 1.0 to clean up data set and produce a n… Added pre processed version 1.0 to clean up data set and produce a n… May 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@shivanshuk