Explain timeouts on Windows AppFabric Cache

2 באוגוסט 2012

3 comments

I had many customers complaining about performance degradation, timeout errors and other exceptions they got when using Windows AppFabric Cache.

When digging into the logs we found three popular Microsoft.ApplicationServer.Caching.DataCacheException errors:

  1. ErrorCode<ERRCA0018>:SubStatus<ES0001>:The request timed out.
  2. ErrorCode<ERRCA0017>:SubStatus<ES0006>:There is a temporary failure.
  3. ErrorCode<ERRCA0016>:SubStatus<ES0001>:The connection was terminated.

To learn about the server condition I run the Get-CacheClusterHealth Windows PowerShell Command as described in the server Health Monitoring document.

To verify the client situation I run the following command : Netstat –nat | find “22233” | wc –l
(The wc utility can be found here.)
This tells us how many connection the client is trying to establish. If we get large numbers (more than 50) it means that there is a situation of: client network contention. The client is trying to establish too many connection yet someone blocks the client from establishing them.

We can also look at WCF performance counters and search for the numbers of connections.

To fix client network contention we have to configure some throttling configuration:

AppFabric client config:
<dataCacheClient requestTimeout="15000" channelOpenTimeout="3000" maxConnectionsToServer="100"…

when using the cache on http channel for example in Azure Cache it is required to configure ServicePointManager as well. so In each client make sure this is called on start:

    ServicePointManager.UseNagleAlgorithm = false;
    ServicePointManager.Expect100Continue = false;
    ServicePointManager.SetTcpKeepAlive(false);
    ServicePointManager.DefaultConnectionLimit = 1000;

Now there will be no bottleneck in the client, no contention and no timeouts.

Enjoy

Manu

Add comment
facebook linkedin twitter email

כתיבת תגובה

האימייל לא יוצג באתר. (*) שדות חובה מסומנים

תגי HTML מותרים: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

3 comments

  1. bally13 באוגוסט 2012 ב 0:53

    Hi ,
    Can we have a call for theabove resolution.
    Bally

    להגיב
  2. botanical slimming gel19 בספטמבר 2013 ב 11:10

    clases have 3 or higher ccinterrupts With no Generate, and so they consider the s#ty 10% dmg may recompense all that nerfs…searcher 3rd r gooin to be able to terrible in five.Three.and then for dude shut up
    botanical slimming gel http://whobuysbooks.info/article.php?id=8659

    להגיב
  3. bee pollen weight loss2 בנובמבר 2013 ב 11:00

    My concern is, I have constantly been Extremely sluggish at reducing weight. I commonly get incredibly frustrated and quit for the reason that my progress is so gradual. Anyone had talked about to me that i could choose a bee pollen weight loss http://www.dailystrength.org/people/3054858/journal/7970145 help (e.g.: a detox cleanser, supplements etcetera.) to leap start my gradual process. I am thinking whenever they basically do the job Is it a bad strategy Are they addictive or even a midsection of money?

    להגיב