Jump to content
DOSBODS
  • Welcome to DOSBODS

     

    DOSBODS is free of any advertising.

    Ads are annoying, and - increasingly - advertising companies limit free speech online. DOSBODS Forums are completely free to use. Please create a free account to be able to access all the features of the DOSBODS community. It only takes 20 seconds!

     

Big Data Question


Recommended Posts

10 minutes ago, Stunley Andwin said:

Is it a space separated or comma separated file? Can't you just load it into a spreadsheet?

https://stackoverflow.com/questions/21759382/how-do-i-open-space-delimited-file-in-microsoft-excel

Maybe I have misunderstood the question.

It looks like this:

"001016416-05"    ""    "STOEFFLER"    "ROSE"    "M"    ""    "F"    03/10/1936    01/01/1972    "A"    03/19/2013    "D"    "253"    ""    "FRIENDSHIP VILLAGE RD"    ""    ""    "BEDFORD"    "PA"    "15522"    ""    ""    ""    ""    ""    11/03/2020    "0202"    "0202-1"    10/14/2020    ""    "0202"    ""    "SC05100"    "MN2"    "MD57302"    "STH078"    "STS35"    "USC13"    "SR05100-1"    "CNTY"    ""    ""    "0202-1"    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""

 

Link to post
Share on other sites
5 minutes ago, SpectrumFX said:

I don't know how to do this sort if thing in Google sheets, but if you've got excel go to the data menu, Get Data (it's at the far left on the ribbon), from file, from text/cab.

Select your file, and you'll find yourself in an import wizard.

 

Yes, work on it on your local computer with Excel or other spreadsheet.

 

 

 

Link to post
Share on other sites
6 minutes ago, deathfunk said:

It looks like this:

"001016416-05"    ""    "STOEFFLER"    "ROSE"    "M"    ""    "F"    03/10/1936    01/01/1972    "A"    03/19/2013    "D"    "253"    ""    "FRIENDSHIP VILLAGE RD"    ""    ""    "BEDFORD"    "PA"    "15522"    ""    ""    ""    ""    ""    11/03/2020    "0202"    "0202-1"    10/14/2020    ""    "0202"    ""    "SC05100"    "MN2"    "MD57302"    "STH078"    "STS35"    "USC13"    "SR05100-1"    "CNTY"    ""    ""    "0202-1"    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""

 

Check your Text To Columns settings. Untick everything first.

Link to post
Share on other sites
23 minutes ago, deathfunk said:

It looks like this:

"001016416-05"    ""    "STOEFFLER"    "ROSE"    "M"    ""    "F"    03/10/1936    01/01/1972    "A"    03/19/2013    "D"    "253"    ""    "FRIENDSHIP VILLAGE RD"    ""    ""    "BEDFORD"    "PA"    "15522"    ""    ""    ""    ""    ""    11/03/2020    "0202"    "0202-1"    10/14/2020    ""    "0202"    ""    "SC05100"    "MN2"    "MD57302"    "STH078"    "STS35"    "USC13"    "SR05100-1"    "CNTY"    ""    ""    "0202-1"    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""    ""

 

If that is a single row of data, does that by itself copy ok into Sheets?

if so, try copying in smaller chunks, e.g. half the Notepad file. If that doesn’t work, try even fewer rows until it does work. There may be a bit of dodgy data somewhere.

Link to post
Share on other sites
1 minute ago, Stuffed said:

If that is a single row of data, does that by itself copy ok into Sheets?

if so, try copying in smaller chunks, e.g. half the Notepad file. If that doesn’t work, try even fewer rows until it does work. There may be a bit of dodgy data somewhere.

I tried with 5 lines and it does work. Sadly Allegheny County has around 940,000 voters so even 1000 at a time is going to take me days and I will still run into the maximum cell usage part way through.

Link to post
Share on other sites
27 minutes ago, maudit said:

Do you have any statistical software on your computer you could use? I work with big datasets (some 100GB +) but I wouldn't touch spreadsheets for any data manipulation. R is free.

R also has a learning curve. 

Any chance you could help him out? 

Any of the Dosbods data and database experts willing to give some help to Deathfunk so he can get this in order? 

Google sheets won't help. 

Link to post
Share on other sites
10 minutes ago, Roger_Mellie said:

R also has a learning curve. 

Any chance you could help him out? 

Any of the Dosbods data and database experts willing to give some help to Deathfunk so he can get this in order? 

Google sheets won't help. 

I'm a solutions guy but not on time or budget so I'm out. 

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...