04-26-2012 05:54 AM - edited 04-26-2012 05:55 AM
Symptom:
Exchange Server Event error MSExchangeIS 9646
==================================================
Mapi session "/O=ORG/OU=SITE/cn=Recipients/cn=besadm" exceeded the maximum of 500 objects of type "objtFolder".
==================================================
Issue:
Open Item Limits set on Exchange server for performance reasons.
http://support.microsoft.com/default.aspx?scid=kb;
http://technet.microsoft.com/en-us/library/ff47761
Ignore:
http://www.blackberry.com/btsc/KB20878 - lazy/dangerous
Changing Exchange values is not recommended in large environments.
Cause:
In our environment "Nice" users selecting "Folder redirection" on their BB devices that have folder structure with more than 500 sub folders. Please note that it could be two top level folders selected individually not having 500 sub folders each, with totalling together more than the threshold. So you get the idea.
Workaround:
Set users to default Inbox and Sent items only, providing they have not created a folder sub structure in there that will break the limit.
http://www.blackberry.com/btsc/KB04297
Tracing:
Now we are getting to a fun part that is not documented anywhere.
There is no way of telling what "Nice" user/s causes the error. As Exchange server logs only the BES service account with 9646 error.
Next step is crucial:
1. Run w32tm /resync on Exchange servers and BES servers that so the time between them match to the second.
2. Wait for a couple Exchange 9646 error to occur
3. Search ALRT logs on active BES 5 servers for the exact time 9646 error occurred.
You may get a match straight away but I found it to be not 100%. Giving time for logging multiple 9646 events will get you there. Looking in MAGT logs does did not do the trick in our environment because they were too busy logging other useless BES info.
ALRT Extract for "Nice" user causing issue
==================================================
[30000] (04/24 08:09:29.688):{0x7AC} [Alarm::ActivateAlarm] Queuing alarm: <N/A> | BlackBerry Messaging Agent HABES1 Agent 5 (Application Event Log on BESSERVER1) | 04/24/2012 08:09:29 (AFF12345) -> {niceuser@domain.com} MAPIMailbox::CheckUserOriginatedItem - OpenEntry (0x80004005) failed, RefId=-1999415179, MsgFolderId=-3, FolderId=0
[30000] (04/24 08:09:29.688):{0x81C} Alarm::ThreadProc: Received an alarm message
==================================================
4. Check results by going though article below and see if user/s have BB "Folder redirection" enabled.
http://www.blackberry.com/btsc/KB04297
5. Remove BB "Folder redirection" from user targeting large sub folder structure.
6. Restart BES services and with luck you nailed the issue with 9646 errors not coming back.
I am on AT&T. Please edit your Personal Profile with your DEVICE TYPE, DEVICE OS and Carrier
04-26-2012 10:31 AM
It is a fun one to deal with.
Did you have any questions or posting your adventure?
Click here to Backup the data on your BlackBerry Device! It's important, and FREE!
BESAdmin's, please make a signature with your BES environment info. SIM Free BlackBerry Unlocking FAQ
Follow me on Twitter @knottyrope
04-30-2012 04:31 AM
Had some issues posting with HTML from winword, but rich text seems a lot less error prone. Thanks.
I am on AT&T. Please edit your Personal Profile with your DEVICE TYPE, DEVICE OS and Carrier
05-04-2012 11:35 AM
so you posted a solution to your issue?
Click here to Backup the data on your BlackBerry Device! It's important, and FREE!
BESAdmin's, please make a signature with your BES environment info. SIM Free BlackBerry Unlocking FAQ
Follow me on Twitter @knottyrope
05-08-2012 07:52 AM
That is correct. Solution is provided in the article above.