Best query tool for 50 million records? Server or Client-based?

tomcam · 02-02-2009, 06:39 PM

I have a database of 50 million customer purchase records. I have heretofore done little with them but am about to mine the heck out of them. (who's bought dog training products since 2005, who signed up for our service but purchased nothing in the last year, etc.) Our database is in PostgreSQL, but of course I don't mind exporting to another format.

Ideally I'd be able to construct queries and then save them under a name, sort of like bookmarking a site. Pretty isn't necessary. Fast is preferred. I'm open to client solutions like Access or FileMaker. PC or Mac would be fine. If online, I'm open to a PHP script, like maybe ezSQL or Appgini. Dedicating web server to this is fine too, as is using Amazon.

Main question is whether the tool can handle 50 million records efficiently.

yaz8888 · 02-02-2009, 08:04 PM

I'd use SQL Server with that many records. Easy to learn and use.

Patrice Le Vexier · 02-03-2009, 08:44 AM

Yes, you can use SQL Server Management Studio for that, and create views you can save.

You can even use access and connect it to those views, it would be slower but more user friendly.

Patrice

ChrisBraddock · 02-03-2009, 09:34 PM

Maybe you're just after a report writer that can hook up to the existing PostgreSQL. Actuate maybe? Google, "postgresql report writer" ?

02-02-2009, 06:39 PM	#1
tomcam Tom Campbell War Room Member Join Date: Jan 2007 Location: Seattle, WA Posts: 381 Blog Entries: 12 Thanks: 278 Thanked 118 Times in 61 Posts Social Networking	Best query tool for 50 million records? Server or Client-based? I have a database of 50 million customer purchase records. I have heretofore done little with them but am about to mine the heck out of them. (who's bought dog training products since 2005, who signed up for our service but purchased nothing in the last year, etc.) Our database is in PostgreSQL, but of course I don't mind exporting to another format. Ideally I'd be able to construct queries and then save them under a name, sort of like bookmarking a site. Pretty isn't necessary. Fast is preferred. I'm open to client solutions like Access or FileMaker. PC or Mac would be fine. If online, I'm open to a PHP script, like maybe ezSQL or Appgini. Dedicating web server to this is fine too, as is using Amazon. Main question is whether the tool can handle 50 million records efficiently.

02-02-2009, 08:04 PM	#2
yaz8888 Active Warrior Join Date: Oct 2008 Posts: 98 Thanks: 0 Thanked 1 Time in 1 Post	Re: Best query tool for 50 million records? Server or Client-based? I'd use SQL Server with that many records. Easy to learn and use.
	Latest alternatives to Leather Gym Gloves

02-03-2009, 08:44 AM	#3
Patrice Le Vexier HyperActive Warrior War Room Member Join Date: Jun 2008 Posts: 300 Thanks: 67 Thanked 72 Times in 27 Posts Contact Info	Re: Best query tool for 50 million records? Server or Client-based? Yes, you can use SQL Server Management Studio for that, and create views you can save. You can even use access and connect it to those views, it would be slower but more user friendly. Patrice
	Professional Website and Software Development - www.patricelevexier.com "To get something you never had, you have to do something you never did"

02-03-2009, 09:34 PM	#4
ChrisBraddock Active Warrior Join Date: Feb 2009 Location: South New Jersey Posts: 50 Thanks: 10 Thanked 4 Times in 4 Posts	Re: Best query tool for 50 million records? Server or Client-based? Maybe you're just after a report writer that can hook up to the existing PostgreSQL. Actuate maybe? Google, "postgresql report writer" ?