I was unfamiliar with Cray's stance until you mentioned it and I'm curious where this leads us when discussing big data? Specifically, "sets" of big data. Since we (as humans) are storing more and more data (Hoarders?), and we want to be able to analyze it in any number of ways, I wonder what are the implications of storing and processing large amounts of data?

It seems to me that as data stored reaches gargantuan proportions, that by necessity the jobs that process such data will all require gargantuan amounts of resources to be able to complete successfully.

It also seems to me, that in the large scheme of things we are very early in the computing age, and in an even earlier (infantile?) developmental stage of data storage.

I wonder what are some theoretical solutions to break down gargantuan data into manageable chunks? Even partitioned data will become unmanageable (I think) at the current rate of data storage.

Honestly, I'm kind of dreading being a DBA over the next 25 years (give or take 20) when contemplating how much data I may be responsible for managing (performance with backup and recovery). I'm excited about seeing what breakthroughs we come up with technology wise, but I'm not looking forward to having to manage it. (If that makes sense)

Chris Taylor
Sr. Oracle DBA
Ingram Barge Company
Nashville, TN 37205

"Quality is never an accident; it is always the result of intelligent effort."
-- John Ruskin (English Writer 1819-1900)

CONFIDENTIALITY NOTICE: This e-mail and any attachments are confidential and may also be privileged. If you are not the named recipient, please notify the sender immediately and delete the contents of this message without disclosing the contents to anyone, using them for any purpose, or storing or copying the information on any medium.

-----Original Message-----
From: oracle-l-bounce@freelists.org On Behalf Of Mark W. Farnham
Sent: Tuesday, January 31, 2012 8:17 AM
To: oracle-l@freelists.org
Subject: RE: Killer SQL and PGA


The tradeoff here is whether to utilize virtual memory to allow gargantuan jobs to theoretically be processed at all. Seymour Cray nailed that in one when he was asked why his systems did not support virtual memory.

It will always be possible to concoct queries and problems that cannot be solved within the limits of any arbitrary amount of real memory.


Search Discussions

  • MacGregor, Ian A. at Jan 31, 2012 at 6:22 pm
    You may be interested in

    From: oracle-l-bounce@freelists.org [oracle-l-bounce@freelists.org] On Behalf Of Taylor, Chris David [ChrisDavid.Taylor@ingrambarge.com]
  • Joel Patterson at Jan 31, 2012 at 7:00 pm
    I have a 17Gb table I would like to replicate to either oracle or sqlserver.

    It contains a LONG data type columns which is incompatible with materialized views.


    Joel Patterson
    Database Administrator
    904 727-2546

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouporacle-l @
postedJan 31, '12 at 2:55p
activeJan 31, '12 at 7:00p



site design / logo © 2022 Grokbase