Changed my workstation setup a little bit - Page 2 - Miata Turbo Forum - Boost cars, acquire cats.

Welcome to Miataturbo.net   Members
 


Insert BS here A place to discuss anything you want

Reply
 
 
 
LinkBack Thread Tools Search this Thread
Old 07-19-2012, 02:46 PM   #21
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

SSD benchmark:


RAID 10 benchmark:
Attached Thumbnails
Changed my workstation setup a little bit-ssd-bench.png   Changed my workstation setup a little bit-raid10-bench.png  
UrbanSoot is offline   Reply With Quote
Old 07-19-2012, 03:25 PM   #22
Boost Pope
iTrader: (8)
 
Joe Perez's Avatar
 
Join Date: Sep 2005
Location: Chicago (Over two miles from Wrigley Field. Fuck the Cubs. Fuck them in their smarmy goat-hole.)
Posts: 26,317
Total Cats: 1,915
Default

I guess I've been lucky. Aside from one OCZ SSD, I haven't had a total failure of a hard drive (with loss of data) in more than 10 years.

For a long time, I was a huge fan of Deskstars. Back when they were actually still IBM. Even during the era when they were suffering massive failures left and right, I never had one fail on me. One of 'em did develop a weird clicky noise, but it ran like that for several years. The 2TB drive in my media server is a Hitachi 7K2000, which I bought right when they first came out.

I had a Toshiba 1.8" drive start to go out in my Vaio a few years ago, but it was gradual. Started making a whining noise, but it ran for more than a week like that, giving me plenty of time to back it up and order a replacement.

I've had a couple of Seagates and WDs over the as few years as well. No problems with any of them.

In fact, the last drive which I can honestly recall suffering a total failure was a full-height, 5.25" SCSI drive made by Control Data Corporation, which I think was somewhere around 100MB. The spindle bearings failed.


Still, I've gotten pretty ---- about backups. Every machine I use on a regular basis either contains a dedicated internal backup drive or is linked to a dedicated NAS backup volume, and the machine performs a differential backup of itself every single night. This way I'm protected not just from physical faults, but also from data corruption which a RAID would be powerless to stop. (eg: if you hose the OS, or accidentally over-write a file, etc., the RAID will just faithfully make a duplicate copy of the bad data. With differential backups, I have access to 30 days worth of valid data, and can revert either individual files or the whole machine back to any point in the past month.)
Joe Perez is offline   Reply With Quote
Old 07-19-2012, 03:53 PM   #23
Elite Member
iTrader: (2)
 
Join Date: Jan 2007
Location: Los Angeles, CA
Posts: 8,782
Total Cats: 119
Default

Quote:
Originally Posted by UrbanSoot View Post
One of my clients has a 58TB SAN that they've paid $500k for. It uses 3TB 7200RPM Hitachi Deskstar drives. It has been running fine for about 2 months now but I'm waiting for drives to start failing one-by-one.

$500K. That's extraordinarily expensive for SATA drives. I just left one of the top 3 SAN data storage companies in the world and that pricing is very high. Sounds like they had a big bunch of other stuff bundled in? I know, because I wrote the quotes...



Quote:
Originally Posted by Joe Perez View Post
Still, I've gotten pretty ---- about backups. Every machine I use on a regular basis either contains a dedicated internal backup drive or is linked to a dedicated NAS backup volume, and the machine performs a differential backup of itself every single night. This way I'm protected not just from physical faults, but also from data corruption which a RAID would be powerless to stop. (eg: if you hose the OS, or accidentally over-write a file, etc., the RAID will just faithfully make a duplicate copy of the bad data. With differential backups, I have access to 30 days worth of valid data, and can revert either individual files or the whole machine back to any point in the past month.)
Good boy. Among the many things I'm an expert in (not wrenching, duh), I'm an expert in data storage. Now the question I have for you is: are the backups offsite?

I back up my stuff onsite to my NAS and also send everything to the cloud. Whee.
Faeflora is offline   Reply With Quote
Old 07-19-2012, 05:11 PM   #24
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

My desktop has only local backup (on RAID10 though, but with shitty drives) since I only deal with code and EC2 credentials which fit fine on an encrypted volume of a flash drive. Everything else is dispensable. All of my VMs are in a cage with a proper KVM/QCOW2 over Gluster setup.

I'm running Supermicro 2U boxes with 6 hot swap bays and an Atom-based Mini-ITX server board. The whole setup of 3 boxes (3x replicas with RAID10 behind them) cost me right around $3,604 from NewEgg (drives were purchased bulk from eBay). That's only 1.5TB though (500GB SATA WD Black) but it's 400Mbps on writes and 650Mbps on reads. That's with absolutely no cache other then buffer on hard drives themselves.

If you reconfigure it slightly and use same 3TB drives and larger enclosures + RAID controller to handle more drives, it will cost ~$0.50-$0.60/GB.

That's $8.62/GB that they've paid by the way.
UrbanSoot is offline   Reply With Quote
Old 07-19-2012, 10:33 PM   #25
Elite Member
iTrader: (9)
 
Saml01's Avatar
 
Join Date: Jul 2007
Location: NYC
Posts: 5,730
Total Cats: 2
Default

No offense, but I haven't seen an e-pen0r circle jerk this big since I stopped posting at the hardforums.

I feel like i'm back in 1999.

If yo dont mind, What do you guys do anyway? If I had to guess id say either you operate a colo, lease rack space in a colo or consult data management services.
Saml01 is offline   Reply With Quote
Old 07-19-2012, 11:03 PM   #26
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

Quote:
Originally Posted by Saml01 View Post
No offense, but I haven't seen an e-pen0r circle jerk this big since I stopped posting at the hardforums.

I feel like i'm back in 1999.

If yo dont mind, What do you guys do anyway? If I had to guess id say either you operate a colo, lease rack space in a colo or consult data management services.
DevOps consulting, infrastructure architecture, hybrid (private + public) infrastructure management, application lifecycle management (automated deployment, QA, etc), and a little bit of hosting on the side.
UrbanSoot is offline   Reply With Quote
Old 07-20-2012, 01:16 AM   #27
Boost Pope
iTrader: (8)
 
Joe Perez's Avatar
 
Join Date: Sep 2005
Location: Chicago (Over two miles from Wrigley Field. Fuck the Cubs. Fuck them in their smarmy goat-hole.)
Posts: 26,317
Total Cats: 1,915
Default

Quote:
Originally Posted by Faeflora View Post
Now the question I have for you is: are the backups offsite?
It depends on how you look at it.

The overnight differential backups are all on-site, to dedicated hard drives co-located with the PCs which they are backing up. Some in the same physical case, others in the same room via USB or the next room over via ethernet.

I do have one USB drive which holds a mirror of my primary home PC which I keep at the office, though I'm fairly undisciplined about updating it. Maybe once every three or four months I remember to bring it home and cycle it.

Of late, I've started using DropBox (cloud storage) for projects that I am actively working on. This has the obvious benefit of mirroring the data across all of my PCs including both laptops so that I can access it wherever I am, and the incidental benefit of creating de-facto backup copies of everything in five different places in real time. Dropbox, of course, does not guard against accidental data corruption, so I include my dropbox directory in the nightly differential backups of two of my PCs- one at home, one at the office.
Joe Perez is offline   Reply With Quote
Old 07-20-2012, 10:35 AM   #28
Elite Member
iTrader: (9)
 
Saml01's Avatar
 
Join Date: Jul 2007
Location: NYC
Posts: 5,730
Total Cats: 2
Default

Quote:
Originally Posted by UrbanSoot View Post
DevOps consulting, infrastructure architecture, hybrid (private + public) infrastructure management, application lifecycle management (automated deployment, QA, etc), and a little bit of hosting on the side.
So in a nutshell you make sure a companies production, development and test environments meet application requirements from a technical point of view, are always running properly and you maintain a process for deployment of applications/changes from one to the other doesn't affect the system as a whole?
Saml01 is offline   Reply With Quote
Old 07-20-2012, 01:33 PM   #29
Elite Member
iTrader: (2)
 
Join Date: Jan 2007
Location: Los Angeles, CA
Posts: 8,782
Total Cats: 119
Default

Urban. EC2?

You use AWS? I find AWS very interesting because it puts infrastructure management in the hands of developers. I learned all about it when I interviewed with Amazon a few years back. Bezos is a visionary.
Faeflora is offline   Reply With Quote
Old 07-20-2012, 03:34 PM   #30
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

EC2 is OK. It's very limited on resources and also very expensive. This is why I manage hybrid infrastructures (your own metal is always cheaper).

Saml01 - not exactly. I mostly focus on auto-scaling and easy deployment to a large cluster. Most of my clients have distributed applications so there are LOTS of different components that are mini applications on their own. Real complexity comes in optimization. Think about it this way - ~10x c1.medium (app servers) + 5x m1.small (web) + 2x c1.large (queue broker) + other crap. It all adds up to a large sum of money and my job is to find all the things that can be optimized for lower disk I/O and network I/O. Once that is done, I go through application code (whatever language it is written in) and try finding obvious bottlenecks that can reduce latency even further.
UrbanSoot is offline   Reply With Quote
Old 07-22-2012, 03:33 PM   #31
Elite Member
iTrader: (9)
 
Saml01's Avatar
 
Join Date: Jul 2007
Location: NYC
Posts: 5,730
Total Cats: 2
Default

That's pretty impressive. What do you do when you dont have access to the code? Not every company develops their own applications.
Saml01 is offline   Reply With Quote
Old 07-22-2012, 05:02 PM   #32
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

I mostly deal with start-ups that have just secured their first/second round of financing and are looking to scale their infrastructure
UrbanSoot is offline   Reply With Quote
Old 07-24-2012, 05:30 PM   #33
Elite Member
iTrader: (9)
 
Saml01's Avatar
 
Join Date: Jul 2007
Location: NYC
Posts: 5,730
Total Cats: 2
Default

Makes sense.

Do they find you or do you find them?
Saml01 is offline   Reply With Quote
Old 07-24-2012, 06:14 PM   #34
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

Both. Helps to have lots of contacts in the field I also do presentations at local tech meetups once in a while so that is another way to pick up some work.
UrbanSoot is offline   Reply With Quote
Old 08-06-2012, 08:01 PM   #35
Elite Member
Thread Starter
iTrader: (24)
 
Join Date: Jun 2007
Location: Sherman Oaks, CA
Posts: 4,481
Total Cats: 3
Default

Cleaned up wiring a little

UrbanSoot is offline   Reply With Quote
 
 
Reply

Related Topics
Thread Thread Starter Forum Replies Last Post
Project Gemini - Turbo Civic on the Cheap Full_Tilt_Boogie Build Threads 58 Yesterday 10:04 PM
WTB MP62 (Hotside) (NB2) Rick02R WTB 3 01-03-2016 08:18 PM
Leaky Wilwoods mx592 Suspension, Brakes, Drivetrain 1 10-01-2015 01:45 AM
Low oil pressure after 1.8 swap and new turbo setup JesseTheNoob DIY Turbo Discussion 15 09-30-2015 03:44 PM


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off



All times are GMT -4. The time now is 06:22 AM.