Comments on: On Transfer and performance http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance Thu, 01 Jun 2017 18:51:00 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: brian http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/comment-page-1#comment-48552 brian Mon, 16 Jun 2008 03:48:44 +0000 http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/#comment-48552 @Mark - I wasn't aware you could override caching on a per-object basis; I will take a look at that. Thanks! It's worth noting that we're not just talking about thousands of operations at a crack - with a reasonable timeout of 60 seconds, this fairly simple mail blast would have failed with as few as 120 emails. Going back to straight SQL has resolved my issues and I'm back to 2400 messages/minute. It is taking some trial and error to find when to use the hammer and when to leave it alone. :) @Mark – I wasn’t aware you could override caching on a per-object basis; I will take a look at that. Thanks!

It’s worth noting that we’re not just talking about thousands of operations at a crack – with a reasonable timeout of 60 seconds, this fairly simple mail blast would have failed with as few as 120 emails. Going back to straight SQL has resolved my issues and I’m back to 2400 messages/minute.

It is taking some trial and error to find when to use the hammer and when to leave it alone. :)

]]> By: Brian Kotek http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/comment-page-1#comment-48548 Brian Kotek Mon, 16 Jun 2008 02:12:48 +0000 http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/#comment-48548 Very true, Transfer is absolutely not meant for large bulk SQL operations. So for large numbers of queries, inserts, etc., you are much better served to do this in straight SQL. Very true, Transfer is absolutely not meant for large bulk SQL operations. So for large numbers of queries, inserts, etc., you are much better served to do this in straight SQL.

]]> By: Mark Mandel http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/comment-page-1#comment-48547 Mark Mandel Mon, 16 Jun 2008 02:12:04 +0000 http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/#comment-48547 Brian, Yup, I would agree - using Transfer to do large batch operations where you insert thousands of rows into your DB in one big go, is defintely a case of trying to stick a square peg in a round hole. I would also advocate the usage of straight SQL, or just turn off the caching for that object entirely, and see if either of those options meets your needs. Brian,

Yup, I would agree – using Transfer to do large batch operations where you insert thousands of rows into your DB in one big go, is defintely a case of trying to stick a square peg in a round hole.

I would also advocate the usage of straight SQL, or just turn off the caching for that object entirely, and see if either of those options meets your needs.

]]> By: Justin Carter http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/comment-page-1#comment-48527 Justin Carter Sun, 15 Jun 2008 08:37:54 +0000 http://www.ghidinelli.com/2008/06/14/on-transfer-and-performance/#comment-48527 I mostly just want to subscribe to the comments to see what kind of advice people can offer, but I'd be interested to hear how you end up resolving this too :) I mostly just want to subscribe to the comments to see what kind of advice people can offer, but I’d be interested to hear how you end up resolving this too :)

]]>