Microsoft sends wrong estimate, which blanks calendars (but not tasks) #274

llvilanova · 2024-09-06T11:30:46Z

Your environment

TbSync version: 4.11
EAS-4-TbSync version: 4.12
Thunderbird version: 128.1.1esr

Expected behavior

Calendar in my office365 account gets populated with all entries created in the past.

Actual behavior

Only newly created calendar entries (since upgrade to TB 128 and respective TbSync plugin updates) are shown in TB's calendar. Old entries are not retrieved even after I tell TbSync that "synchronization period" is "all".

Using the debugger to force "SyncKey" to "0" in sync.requestRemoteChanges (sync.js:404) results in Sync error code 4 from the server.

Steps to reproduce

In my case, just upgrading to TB 128 and respective TbSync plugin updates.

jobisoft · 2024-09-09T06:06:12Z

Are you using the Flatpack version of Thunderbird 128? Or Snap?

jobisoft · 2024-09-09T07:56:53Z

Since I have not changed the version for TB115 and this is reported by users of the OLD version for TB115 and the NEW version for TB128, Microsoft changed something. I fear this is out of my control.

ottomano · 2024-09-09T09:43:45Z

Since I have not changed the version for TB115 and this is reported by users of the OLD version for TB115 and the NEW version for TB128, Microsoft changed something. I fear this is out of my control.

Please keep us posted on this. I just reinstalled TB 128 and now I can't retrieve all my calendar entries. 😕

jobisoft · 2024-09-09T11:00:12Z

I do not think this is related to Thunderbird 128. Reports indicate that Thunderbird 115 is affected as well. It appears only certain Microsoft services are affected.

jobisoft · 2024-09-09T15:13:13Z

If you enable debug logging, you will find such an entry on all fresh synced (disabled and then re-enabled) calendars:

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Response>
<Status>1</Status>
<Collection>
<CollectionId>14</CollectionId>
<Estimate>0</Estimate>
</Collection>
</Response>
</GetItemEstimate>

The server sends that he has no data for calendars.

Note: It does send the correct estimate for tasks and contacts.

Microsoft messed up their server.

jobisoft · 2024-09-09T16:04:40Z

It may be time for some background information: My EAS provider was not written for Office 365 or big Exchange Servers (EWS). It was written for true Exchange Active Sync Servers (EAS), which do not offer any other protocol to access them, but use EAS as their primary access protocol.

My users learned by trying, that Office365/Hotmail/Outlook.com also "works" with my provider, which means Microsoft supports the EAS protocol on these platforms. But EAS is not the primary protocol there, that would be EWS, OWA or Graph. Users did realize that already, because EAS does not provide the full feature set, like accessing shared calendars. After being asked, I did put some effort into supporting the Microsoft platforms, for example by implementing OAUTH support.

If Microsoft did now mess up the EAS interface to their platform, there is nothing I can do. As reported by many of you, it suddenly stopped working, and it is not (!) related to the recent update, because it also fails for users who are still on Thunderbird 115.

I can still sync calendars with the servers my EAS provider was originally written for.

damien-git · 2024-09-09T17:24:25Z

I am not sure what the estimate is used for in EAS-4-TbSync, but is it possible you would get data if you simply ignore it ? It is just an "estimate" after all...

jobisoft · 2024-09-09T17:47:38Z

That estimate reference was just a hint. I am requesting the full changes after the estimate. But that request comes back empty.

damien-git · 2024-09-09T18:36:59Z

I think ActiveSync can be used by Outlook clients if configured to, to access 365 calendars. There was an issue in February affecting them. So shouldn't this change affect them as well ?

jobisoft · 2024-09-09T18:42:53Z

If they really do use EAS, they could be affected as well. But I assume they use EWS instead. But this is all just guessing. Fact is I follow the spec and it worked for multiple years and now it no longer works for MS.

llvilanova · 2024-09-09T19:30:59Z

Are you using the Flatpack version of Thunderbird 128? Or Snap?

I'm using the version packaged in Debian, and I'm indeed accessing my Office365 account.

wiraki · 2024-09-10T12:14:01Z

I do not think this is related to Thunderbird 128. Reports indicate that Thunderbird 115 is affected as well. It appears only certain Microsoft services are affected.

Can confirm on 115 .deb version as well.

Thanks for all the info. What a bummer :(
Any suggestions where to look for updates/fixes on this?

schillic · 2024-09-11T07:42:19Z

It just started working again for me. Hooray!

bubble75 · 2024-09-11T07:53:47Z

One more observation: If event arrives while Thunderbird is running with ActiveSync account is enabled - it is shown in calendar. Once I disable and reenable account or restart Thunderbird - it is no longer shown.

bubble75 · 2024-09-11T08:01:44Z

One more observation: If event arrives while Thunderbird is running with ActiveSync account is enabled - it is shown in calendar. Once I disable and reenable account or restart Thunderbird - it is no longer shown.

Just started to work again.

ottomano · 2024-09-11T08:05:47Z

Still not working for me on Office 365 calendar, but now I have big hopes after it started working for others. (fingers crossed)

schor123 · 2024-09-11T11:29:42Z

Can confirm it started working again. I removed all calendars, uninstalled tbsync; re-started Thunderbird, re-installed tbsync + exchange provider and there we go: all calendars/tasks are back.

scylla999 · 2024-09-11T13:23:19Z

I also confirm it's working again after removing calendars, uninstalling both TbSync and EAS-4-TbSync, restarting Thunderbird, re-installing the extensions and then re-adding calendars with M365 Oath2.

damien-git · 2024-09-11T14:16:04Z

Tried all that: removing calendars, uninstalling TbSync and EAS-4-Tbsync, restarting Thunderbird, re-installing the extensions and re-adding Office365 calendars - still nothing.

ottomano · 2024-09-11T14:16:27Z

Tried all that: removing calendars, uninstalling TbSync and EAS-4-Tbsync, restarting Thunderbird, re-installing the extensions and re-adding Office365 calendars - still nothing.

Same issue here, unfortunately.

faz17 · 2024-09-11T14:20:48Z

Tried all that: removing calendars, uninstalling TbSync and EAS-4-Tbsync, restarting Thunderbird, re-installing the extensions and re-adding Office365 calendars - still nothing.

Same here

geg-ck · 2024-09-11T14:37:43Z

Back to working for me. Uncheck the box next calendar in the Sync dialog, sync, re-check the box next to calendar, sync again.

LamyLab · 2024-09-11T16:37:23Z

Same as geg-ck.

jobisoft · 2024-09-11T16:40:16Z

It may be helpful to note which platform.

So instead of "same here", post something like "outlook.com: OK" or "office365: NOK"

NEP1192 · 2024-09-11T16:41:08Z

outlook.Office365.com, not working

TbSync v4.11
ActiveSync v4.12

geg-ck · 2024-09-11T16:53:07Z

Microsoft365 Exchange Online - OK here.
TbSync v4.11
ActiveSync v4.12

eamathw · 2024-09-11T17:04:20Z

outlook.office365.com working
TbSync v4.8
Provider for Exchange ActiveSync v4.8

jobisoft · 2024-09-11T17:06:35Z

outlook.office365.com working TbSync v4.8 Provider for Exchange ActiveSync v4.8

That is even better!

billksun · 2024-09-11T17:16:06Z

outlook.office.com is working here.

U2Vj · 2024-09-12T05:36:58Z

outlook.office365.com working
TbSync v4.8
Provider for Exchange ActiveSync v4.8

presianbg · 2024-09-12T06:27:50Z

Still not working:

EU
Microsoft 365 (Exchange Online) (outlook.office365.com)
TB 128.2.0esr
TbSync v4.11
Provider for Exchange ActiveSync 4.12

mlassnig · 2024-09-12T07:04:46Z

Not working:

TB 128.2.0esr / Debian
Provider for Exchange ActiveSync 4.12
TbSync 4.11
outlook.office365.com

Repeated installs/refreshs... same effect that only new events get loaded in.

ottomano · 2024-09-12T07:32:57Z

TB 128.2.0 esr / Windows 10
outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.

@jobisoft I can provide you debug log via DM if needed

jobisoft · 2024-09-12T07:39:25Z

TB 128.2.0 esr / Windows 10

outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.

@jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here:
#274 (comment)

If the estimate for all your calendars is 0, your server is still not reporting any entries.

ottomano · 2024-09-12T08:35:25Z

TB 128.2.0 esr / Windows 10

outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.
@jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment)

If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result.

Here the XML response


<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>

jobisoft · 2024-09-12T08:38:00Z

TB 128.2.0 esr / Windows 10

outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.
@jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment)
If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result.

Here the XML response
<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>

That is the request.

ottomano · 2024-09-12T08:42:55Z

TB 128.2.0 esr / Windows 10

outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.
@jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment)
If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result.
Here the XML response
<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>
That is the request.

Sorry, my fault.

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Response>
<Status>1</Status>
<Collection>
<CollectionId>6</CollectionId>
<Estimate>0</Estimate>
</Collection>
</Response>
</GetItemEstimate>

jobisoft · 2024-09-12T08:47:52Z

Yep, your server does not report any data for you. I guess you have to keep waiting. Maybe Microsoft is rolling out the fix in waves and it does not hit all servers at the same time.

If that estimate comes back non-zero and you still do not get data, I can start looking at it again. Until then, you have to be patient. Disable and re-enable your TbSync account once a day and see if a fresh sync brings back any data and/or it reports a non-zero estimate.

bermeitinger-b · 2024-09-12T08:49:47Z

It started working for me. So patience is the only way to go :)

Thanks!

faz17 · 2024-09-12T08:59:25Z

Tbsync 4.11
Provider Activesync 4.12
thunderbird 128.2.0 esr
windows 11
outlook.office365.com
EU
still not working. Here is the log

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>2047807048</SyncKey>
<CollectionId>9</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>

presianbg · 2024-09-13T06:58:54Z

Still not working:

EU

Microsoft 365 (Exchange Online) (outlook.office365.com)

TB 128.2.0esr

TbSync v4.11

Provider for Exchange ActiveSync 4.12

It started working... Microsoft being Microsoft :)

ottomano · 2024-09-13T13:55:32Z

TB 128.2.0 esr / Windows 10

outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.
@jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment)
If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result.
Here the XML response
<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>
That is the request.
Sorry, my fault.
<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Response>
<Status>1</Status>
<Collection>
<CollectionId>6</CollectionId>
<Estimate>0</Estimate>
</Collection>
</Response>
</GetItemEstimate>

it started "working" again. But it does not download all entries once. Seems it is slowly downloading few entries each hour (so, now my calendar on TB is roughly at 50% of the real calendar on Outlook).

SirFritz · 2024-09-14T09:22:00Z

This never started working again for me. Instead now on two different computers it locks up Thunderbird when trying to sync calenders.

damien-git · 2024-09-15T21:02:07Z

It finally started working for me too (O365, TB128). I used a read-only ics link while I was waiting.

faz17 · 2024-09-16T10:55:11Z

And finally it's working again also for me!

jobisoft mentioned this issue Sep 9, 2024

Synchronizing to Outlook365 calendar does not show previously existing calendar events jobisoft/TbSync#733

Closed

jobisoft changed the title ~~Calendar contents reset in TB 128, and synckey prevents retrieval~~ Microsoft sends wrong estimate, which blanks calendars (but not tasks) Sep 9, 2024

jobisoft mentioned this issue Sep 9, 2024

TBSync syncs without error but not calender/tasks/contacts available #266

Open

jobisoft mentioned this issue Sep 10, 2024

EAS and MSOffice365 calendars no longer syncing jobisoft/TbSync#734

Closed

Microsoft sends wrong estimate, which blanks calendars (but not tasks) #274

Microsoft sends wrong estimate, which blanks calendars (but not tasks) #274

Comments

llvilanova commented Sep 6, 2024

Your environment

Expected behavior

Actual behavior

Steps to reproduce

jobisoft commented Sep 9, 2024

jobisoft commented Sep 9, 2024

ottomano commented Sep 9, 2024

jobisoft commented Sep 9, 2024

jobisoft commented Sep 9, 2024 • edited Loading

jobisoft commented Sep 9, 2024

damien-git commented Sep 9, 2024

jobisoft commented Sep 9, 2024

damien-git commented Sep 9, 2024

jobisoft commented Sep 9, 2024

llvilanova commented Sep 9, 2024 • edited Loading

wiraki commented Sep 10, 2024

schillic commented Sep 11, 2024

bubble75 commented Sep 11, 2024

bubble75 commented Sep 11, 2024

ottomano commented Sep 11, 2024

schor123 commented Sep 11, 2024

scylla999 commented Sep 11, 2024

damien-git commented Sep 11, 2024

ottomano commented Sep 11, 2024

faz17 commented Sep 11, 2024

geg-ck commented Sep 11, 2024

LamyLab commented Sep 11, 2024

jobisoft commented Sep 11, 2024 • edited Loading

NEP1192 commented Sep 11, 2024 • edited Loading

geg-ck commented Sep 11, 2024 • edited Loading

eamathw commented Sep 11, 2024

jobisoft commented Sep 11, 2024

billksun commented Sep 11, 2024

U2Vj commented Sep 12, 2024

presianbg commented Sep 12, 2024 • edited Loading

mlassnig commented Sep 12, 2024

ottomano commented Sep 12, 2024

jobisoft commented Sep 12, 2024

ottomano commented Sep 12, 2024 • edited Loading

jobisoft commented Sep 12, 2024

ottomano commented Sep 12, 2024

jobisoft commented Sep 12, 2024

bermeitinger-b commented Sep 12, 2024

faz17 commented Sep 12, 2024

presianbg commented Sep 13, 2024

ottomano commented Sep 13, 2024

SirFritz commented Sep 14, 2024

damien-git commented Sep 15, 2024

faz17 commented Sep 16, 2024

jobisoft commented Sep 9, 2024 •

edited

Loading

llvilanova commented Sep 9, 2024 •

edited

Loading

jobisoft commented Sep 11, 2024 •

edited

Loading

NEP1192 commented Sep 11, 2024 •

edited

Loading

geg-ck commented Sep 11, 2024 •

edited

Loading

presianbg commented Sep 12, 2024 •

edited

Loading

ottomano commented Sep 12, 2024 •

edited

Loading