View Issue Details

IDProjectCategoryView StatusLast Update
0000791SOGoWeb Mailpublic2010-09-02 16:23
Reporterwimmer Assigned To 
PrioritynormalSeverityfeatureReproducibilityalways
Status newResolutionopen 
Summary0000791: archiving huge mail folders - show progress indicator
Description

I found problem by archiving huge mail folders.
I'm using dovecot IMAP server, Maildir format.
When I try to archive folder including 0000020:0000011,000 messages (1.2 GB total disk space), SOGo does not finish this job. It is terminated with error:

Proxy Error

The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request GET /SOGo/so/user/Mail/0/folder-INBOX/exportFolder.

Reason: Error reading from remote server

In sogo log I see that messages are still added after displaying that warning.
Maybe session has timed out or some time limit has been reached?
Archiving of smaller (normal) folders works without problem.

TagsNo tags attached.

Relationships

has duplicate 0000801 resolvedludovic Improve the import .ics Web UI 

Activities

wsourdeau

wsourdeau

2010-08-31 14:01

viewer   ~0001403

Hi Milos,

Indeed this is likely due to a timeout, either on the front proxy side, either on the side of the SOGo master process. How much time does it take before the error occurs?

wimmer

wimmer

2010-08-31 14:13

reporter   ~0001404

I measured it just now - it is exactly 5 min.
I'm using apache2 with proxy modul and default setting (without special timeout definitions), memcached, without imapproxy on that box.

wsourdeau

wsourdeau

2010-08-31 14:16

viewer   ~0001405

This seems to be due to mod_proxy then. The timeout for the SOGo master process is 10 minutes and when it's triggered, the message "safety belt -- sending KILL signal to pid XXX" appears in the SOGo logs.

The "ProxyTimeout" Apache directive does indeed default to 300 seconds. Could you try with a value of 600?

wimmer

wimmer

2010-08-31 17:00

reporter   ~0001406

Ok, I insert
ProxyTimeout 600

into SOGo.conf and process of archiving huge mail folder was completed.
So it is fine for me now ;-)

Maybe SOGo could send any "I'm live and in progress" data back to the browser for elimination that long "quiet" time?

It would be nice when SOGo would display some message like "Archiving in progress", because users are not sure if backup works when they do archiving of huge folders and nothing visual happens...

Thanks

ludovic

ludovic

2010-09-02 16:23

administrator   ~0001410

Should also be extended when importing large calendars or address books

Issue History

Date Modified Username Field Change
2010-08-31 14:00 wimmer New Issue
2010-08-31 14:01 wsourdeau Note Added: 0001403
2010-08-31 14:13 wimmer Note Added: 0001404
2010-08-31 14:16 wsourdeau Note Added: 0001405
2010-08-31 17:00 wimmer Note Added: 0001406
2010-09-01 22:43 ludovic Severity minor => feature
2010-09-01 22:43 ludovic Summary archiving huge mail folders => archiving huge mail folders - show progress indicator
2010-09-02 16:22 ludovic Relationship added has duplicate 0000801
2010-09-02 16:23 ludovic Note Added: 0001410