Comments on: Billions (of API requests) Served http://blog.evernote.com/tech/2012/12/10/billions-served/ The Care and Feeding of Elephants Wed, 29 May 2013 13:54:07 +0000 hourly 1 http://wordpress.org/?v=3.5.1 By: Dave Engberg http://blog.evernote.com/tech/2012/12/10/billions-served/#comment-3152 Dave Engberg Fri, 03 May 2013 23:14:04 +0000 http://blog.evernote.com/tech/?p=549#comment-3152 On each shard, we run a single Hibernate configuration with EHCache for second level caching.

]]> By: Vishal http://blog.evernote.com/tech/2012/12/10/billions-served/#comment-3136 Vishal Fri, 03 May 2013 18:52:50 +0000 http://blog.evernote.com/tech/?p=549#comment-3136 Hi Dave,

I was wondering if you use the Hibernate Shards or Implement your own wrapper over Hibernate to allow multiple entity managers for each shard and so on.

Regards,
Vishal
vishal.kr.singh@gmail.com

]]> By: Dave Engberg http://blog.evernote.com/tech/2012/12/10/billions-served/#comment-1138 Dave Engberg Thu, 28 Feb 2013 22:53:24 +0000 http://blog.evernote.com/tech/?p=549#comment-1138 We don’t currently have a requirement for more than daily updates of the reports, since we aren’t doing realtime mid-day tweaking of the service. (E.g. we’re not running a commerce site or something like that.) We’re using SSDs on the systems that currently spend the most time (our ParAccel database servers), and they definitely provide a great performance boost.

]]> By: Dane Nelson http://blog.evernote.com/tech/2012/12/10/billions-served/#comment-1134 Dane Nelson Thu, 28 Feb 2013 17:36:30 +0000 http://blog.evernote.com/tech/?p=549#comment-1134 Great write up, very interesting. Are your reports being generated overnight, and thus don’t need to be real time? Yes, 2 hours is better than 10, but this still limits you to daily pulls. The reason I ask is because there has been a lot of info out there about Intel’s new S3700 series SSD that seems to smoke these types of data analysis operations. So maybe swap your RAID 10 set out with these SSDs to get closer to real time? But of course that assumes you are disk-bound, not CPU or RAM bound.

Thanks again, looking forward to more info on how things progress.
Dane

]]> By: Martin Meyer http://blog.evernote.com/tech/2012/12/10/billions-served/#comment-898 Martin Meyer Sun, 10 Feb 2013 17:38:47 +0000 http://blog.evernote.com/tech/?p=549#comment-898 Your company’s evolution towards Hadoop has been pretty similar to my company’s (Chitika). I predict in the next few months you’ll discover Oozie, Squoop, and Hadoop Streaming. Oh, it’s gonna get exciting then ;-)

]]> By: Mark Rothfield http://blog.evernote.com/tech/2012/12/10/billions-served/#comment-692 Mark Rothfield Thu, 10 Jan 2013 04:08:13 +0000 http://blog.evernote.com/tech/?p=549#comment-692 I’d strongly recommend Yellowfin (http://www.yellowfin.bi) for interactive dashboards. We have used in it embedded into our SaaS offering for a couple of years. It is simple to setup, maintain and use. The scheduled reporting is excellent and can be based upon conditions, effectively creating report alerts. It also has innovative collaboration features, supports GIS reporting, embedding, white labelling, embedding, reporting via API’s. Setting up views and reports is a cinch. Drop me a line, I’d be happy to show you how I use it at my company.

Cheers
Mark

]]>