<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: The Big Grid Two Years Later</title>
	<atom:link href="http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/feed/" rel="self" type="application/rss+xml" />
	<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/</link>
	<description>A DataPig Technologies Blog</description>
	<lastBuildDate>Tue, 07 Sep 2010 07:19:14 -0400</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Letty Links</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-3840</link>
		<dc:creator>Letty Links</dc:creator>
		<pubDate>Thu, 29 Apr 2010 22:53:59 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-3840</guid>
		<description>Like your post. Maybe plus size sundress info might assist someone out there.</description>
		<content:encoded><![CDATA[<p>Like your post. Maybe plus size sundress info might assist someone out there.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: AshRic</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1628</link>
		<dc:creator>AshRic</dc:creator>
		<pubDate>Wed, 22 Jul 2009 13:15:33 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1628</guid>
		<description>I often have to work with data files of over 1 million rows (3 mil+) - but i would never try it in Excel.

In the end (i feel) - databases are for data processing, spreadsheets are for data analysis.

I use SQL Server to get the data down to what i need - then Excel to do the reports etc.</description>
		<content:encoded><![CDATA[<p>I often have to work with data files of over 1 million rows (3 mil+) &#8211; but i would never try it in Excel.</p>
<p>In the end (i feel) &#8211; databases are for data processing, spreadsheets are for data analysis.</p>
<p>I use SQL Server to get the data down to what i need &#8211; then Excel to do the reports etc.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: datapig</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1609</link>
		<dc:creator>datapig</dc:creator>
		<pubDate>Sun, 19 Jul 2009 06:04:48 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1609</guid>
		<description>Marlin:  Thanks for backing me up.  It&#039;s lonely out here in Access-Land.</description>
		<content:encoded><![CDATA[<p>Marlin:  Thanks for backing me up.  It's lonely out here in Access-Land.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: marlin</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1608</link>
		<dc:creator>marlin</dc:creator>
		<pubDate>Sun, 19 Jul 2009 00:08:43 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1608</guid>
		<description>Don&#039;t believe Mike, he really is gay for Access, but seriously folks.....Dick, I have to agree with Mike that we could probably do it quicker in Access, plus Access has a better toolset for automating the process, but I like your thinking and analogy.  And in this case I would NEVER attempt to try and kick your &#039;ladder&#039; because you are comfortable on it, and if you can do this particular task better in Excel, I&#039;m all for it.

Here is my problem with Excel...every college in the world teaches every student how to &#039;use&#039; Excel to do everything, without teaching them anything about data.  So in the real business world, you wind up with Excel-Hell because people try to solve everything with Excel, and Excel doesn&#039;t enforce any data integrity at all.  I&#039;m not lobbying for everyone to be and Access or database guru, just for people to realize that there IS a valid reason to use a database (most business cases that I can think of) and a reason to use Excel (primarily accounting but there are some other valid reasons too).

In the end, if you have a need to do something, and you have a method or process in one or the other, fine and dandy, but be open to other options...

Now, back to my original post...I could have elaborated a bit and stipulated that if I had a million rows in a spreadsheet on a regular basis and had to regularly grab data from it, I would slit my wrists...

You will now be returned to your regular programming...and thanks for listening...;^)</description>
		<content:encoded><![CDATA[<p>Don't believe Mike, he really is gay for Access, but seriously folks&#8230;..Dick, I have to agree with Mike that we could probably do it quicker in Access, plus Access has a better toolset for automating the process, but I like your thinking and analogy.  And in this case I would NEVER attempt to try and kick your 'ladder' because you are comfortable on it, and if you can do this particular task better in Excel, I'm all for it.</p>
<p>Here is my problem with Excel&#8230;every college in the world teaches every student how to 'use' Excel to do everything, without teaching them anything about data.  So in the real business world, you wind up with Excel-Hell because people try to solve everything with Excel, and Excel doesn't enforce any data integrity at all.  I'm not lobbying for everyone to be and Access or database guru, just for people to realize that there IS a valid reason to use a database (most business cases that I can think of) and a reason to use Excel (primarily accounting but there are some other valid reasons too).</p>
<p>In the end, if you have a need to do something, and you have a method or process in one or the other, fine and dandy, but be open to other options&#8230;</p>
<p>Now, back to my original post&#8230;I could have elaborated a bit and stipulated that if I had a million rows in a spreadsheet on a regular basis and had to regularly grab data from it, I would slit my wrists&#8230;</p>
<p>You will now be returned to your regular programming&#8230;and thanks for listening&#8230;;^)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: DataPig</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1596</link>
		<dc:creator>DataPig</dc:creator>
		<pubDate>Fri, 17 Jul 2009 16:44:40 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1596</guid>
		<description>DK:  We should have a race the next time we&#039;re in the same room.

You&#039;ll drive Excel, and I&#039;ll drive Access.</description>
		<content:encoded><![CDATA[<p>DK:  We should have a race the next time we're in the same room.</p>
<p>You'll drive Excel, and I'll drive Access.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: judgepax</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1595</link>
		<dc:creator>judgepax</dc:creator>
		<pubDate>Fri, 17 Jul 2009 16:33:28 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1595</guid>
		<description>It&#039;s rare, tops twice per month, but I do use over 65,536 rows usually for data downloads from online software where your options are .pdf or .xls--obviously, I do not want my local tree-hugger to paper-cut me to death with the printouts...  But 1,048,576 rows does seem excessive.

As to the column increase I LOVE THIS!!  Had a performance management file where there needed to be a column for every day of the year.  365 days &gt; 256 columns so I had to have one file for the first half of the year and a second file for the second half.  Invariably at mid-year, no matter how ofter I explained why there had to be two separte spreadsheets, I would get the questions of:  &quot;Why can&#039;t I see everything? Did you delete it?&quot;  Which would translate in the pointy-hair boss&#039;s mind to:  &quot;Oh, this is just a smoke-screen and she&#039;s not doing her job of daily tracking.&quot;  ARGH!!  So for all the haters, and any Microsoft developers out there considering decreasing the number of columns in 2010, stop the hate.</description>
		<content:encoded><![CDATA[<p>It's rare, tops twice per month, but I do use over 65,536 rows usually for data downloads from online software where your options are .pdf or .xls&#8211;obviously, I do not want my local tree-hugger to paper-cut me to death with the printouts&#8230;  But 1,048,576 rows does seem excessive.</p>
<p>As to the column increase I LOVE THIS!!  Had a performance management file where there needed to be a column for every day of the year.  365 days &gt; 256 columns so I had to have one file for the first half of the year and a second file for the second half.  Invariably at mid-year, no matter how ofter I explained why there had to be two separte spreadsheets, I would get the questions of:  "Why can't I see everything? Did you delete it?"  Which would translate in the pointy-hair boss's mind to:  "Oh, this is just a smoke-screen and she's not doing her job of daily tracking."  ARGH!!  So for all the haters, and any Microsoft developers out there considering decreasing the number of columns in 2010, stop the hate.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bob Phillips</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1588</link>
		<dc:creator>Bob Phillips</dc:creator>
		<pubDate>Thu, 16 Jul 2009 23:17:45 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1588</guid>
		<description>Yeah but scaffolding is safer, you are less likely to fall of.</description>
		<content:encoded><![CDATA[<p>Yeah but scaffolding is safer, you are less likely to fall of.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dick Kusleika</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1587</link>
		<dc:creator>Dick Kusleika</dc:creator>
		<pubDate>Thu, 16 Jul 2009 22:23:55 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1587</guid>
		<description>So my tool set is limited?  OK, yeah, got it.  Message received. :)

Joking aside, I&#039;m calling bullsh*t that you can do it in Access faster.  

Open the text file in Excel, go through the OpenText wizard.  Sort on IP address.  Delete all rows that don&#039;t have the IP address you want.

Now do the same in Access.  Faster?  OK, now get the count of the number of records, email to that number to someone, and throw everything away.  Yep, you only needed the count.  In Excel, I hit Ctl+w and say &#039;no&#039; to saving.  What you do in Access?  Close the database without saving?  I don&#039;t think so.

If I may be so bold, &lt;b&gt;Excel&lt;/b&gt; is the right tool for the above contrived job.  The number of rows is only one factor in deciding which tool you use, and it&#039;s only the most important factor when you have more rows than the tool can handle.

I like Access, but I&#039;m not going to put scaffolding around my house to clean the gutters.  I&#039;ll just use a ladder, thanks.</description>
		<content:encoded><![CDATA[<p>So my tool set is limited?  OK, yeah, got it.  Message received. <img src='http://datapigtechnologies.com/blog/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<p>Joking aside, I'm calling bullsh*t that you can do it in Access faster.  </p>
<p>Open the text file in Excel, go through the OpenText wizard.  Sort on IP address.  Delete all rows that don't have the IP address you want.</p>
<p>Now do the same in Access.  Faster?  OK, now get the count of the number of records, email to that number to someone, and throw everything away.  Yep, you only needed the count.  In Excel, I hit Ctl+w and say 'no' to saving.  What you do in Access?  Close the database without saving?  I don't think so.</p>
<p>If I may be so bold, <b>Excel</b> is the right tool for the above contrived job.  The number of rows is only one factor in deciding which tool you use, and it's only the most important factor when you have more rows than the tool can handle.</p>
<p>I like Access, but I'm not going to put scaffolding around my house to clean the gutters.  I'll just use a ladder, thanks.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: datapig</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1578</link>
		<dc:creator>datapig</dc:creator>
		<pubDate>Wed, 15 Jul 2009 13:12:14 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1578</guid>
		<description>DK:  I suppose it comes down to how comfortable we feel with a certain tool-set.  I would actually bring half a million rows into Access.  Indeed, it would be faster for me to analyze that many rows in Access.  

I am surprised at how many people have commented that they love the increased rows because they can now create pivot tables on large data dumps &quot; 800k - 900k rows&quot;.

Again, a broader skill-set would help here.  I would find it far easier to connect a pivot table to extermal data sources than to actually bring the data into Excel.

I cringe when people say &quot;I hate Access&quot; .  Not because I&#039;m gay for Access.  Because limiting yourslef to a single tool (Excel) can limit options that can potentially help you do things in more productive ways.

Again, I don&#039;t think the increased limits are &quot;bad&quot;.  But of the all the tools I am comfortable with using, Excel is the least adept at handling and analyzing half a million rows.</description>
		<content:encoded><![CDATA[<p>DK:  I suppose it comes down to how comfortable we feel with a certain tool-set.  I would actually bring half a million rows into Access.  Indeed, it would be faster for me to analyze that many rows in Access.  </p>
<p>I am surprised at how many people have commented that they love the increased rows because they can now create pivot tables on large data dumps " 800k &#8211; 900k rows".</p>
<p>Again, a broader skill-set would help here.  I would find it far easier to connect a pivot table to extermal data sources than to actually bring the data into Excel.</p>
<p>I cringe when people say "I hate Access" .  Not because I'm gay for Access.  Because limiting yourslef to a single tool (Excel) can limit options that can potentially help you do things in more productive ways.</p>
<p>Again, I don't think the increased limits are "bad".  But of the all the tools I am comfortable with using, Excel is the least adept at handling and analyzing half a million rows.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Roy MacLean</title>
		<link>http://datapigtechnologies.com/blog/index.php/the-big-grid-two-years-later/comment-page-1/#comment-1577</link>
		<dc:creator>Roy MacLean</dc:creator>
		<pubDate>Wed, 15 Jul 2009 12:06:16 +0000</pubDate>
		<guid isPermaLink="false">http://datapigtechnologies.com/blog/?p=474#comment-1577</guid>
		<description>I think the increased limits are good on both axes. As Dick says, there are lots of worksheets that are event logs, and 64K could easily be too small. Not so sure about columns, but again, 256 was way too small. I can imagine modeling/scientific/analysis applications where you want square matrices with size bigger than 256 x 256.</description>
		<content:encoded><![CDATA[<p>I think the increased limits are good on both axes. As Dick says, there are lots of worksheets that are event logs, and 64K could easily be too small. Not so sure about columns, but again, 256 was way too small. I can imagine modeling/scientific/analysis applications where you want square matrices with size bigger than 256 x 256.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
