Problems with Chunked upload

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
15 messages Options
Reply | Threaded
Open this post in threaded view
|

Problems with Chunked upload

Hans-Helge Bürger
Hi,

I try to implement a WebDAV client for owncloud in PHP but I have a problem with chunking files. I tried to find help at GitHub but they referred me to this mailing list.

I would appreciate your help to find a solution :)


Sincerely,

Hans-Helge Bürger
Entwickler

Telefon: +49 1577 158 3142
E-Mail: [hidden email]

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com


_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Vincent Petry
Hello,

ownCloud's WebDAV chunking does not work the same as regular HTTP chunking.
Also WebDAV in general cannot support PUT with range requests.

ownCloud has its own custom protocol for chunking.
You could have a look how it's implemented in pyocclient: https://github.com/owncloud/pyocclient/blob/master/owncloud/owncloud.py#L414

Or have a look at this documentation: https://github.com/owncloud/core/wiki/spec:-big-file-chunking (only the first part ! Step two is only a spec and not implemented yet)

Cheers,

Vincent

On 18.05.2015 11:14, Hans-Helge Bürger wrote:
Hi,

I try to implement a WebDAV client for owncloud in PHP but I have a problem with chunking files. I tried to find help at GitHub but they referred me to this mailing list.

I would appreciate your help to find a solution :)

GitHub Issue: https://github.com/owncloud/core/issues/16278

Sincerely,

Hans-Helge Bürger
Entwickler
Telefon: +49 1577 158 3142
E-Mail: [hidden email]

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com




_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel


_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

signature.asc (188 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

rahuljain840
In reply to this post by Hans-Helge Bürger
Hi Hans-Helge Bürger,

I got the same error but this time with C#, Have you resolved this issue ? If you have resolved this can you please share your code so that i can where am i doing wrong ?

Thanks in advance.
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Hans-Helge Bürger
I just tried to get this working today but I was not successful :( It seems that there is something Python and / or the developer are not telling us ^^ As soon as I got it working I will post it here.

Hans-Helge Bürger
WordPress Engineer

Telefon: +49 1579 2349 527
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com
http://multilingualpress.profile


Am 9. Juni 2015 bei 18:48:14, rahuljain840 ([hidden email]) schrieb:

Hi Hans-Helge Bürger,

I got the same error but this time with C#, Have you resolved this issue ?
If you have resolved this can you please share your code so that i can where
am i doing wrong ?

Thanks in advance.



--
View this message in context: http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15230.html
Sent from the Developers mailing list archive at Nabble.com.
_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

rahuljain840
Thanks for your quick reply.

Seems like no one has ever used chunk uploading with any other language then Phython. Also the code on github is also not the officials. OwnCloud has not provided its proper documentation like any other storage provides like dropbox or skydive.

On Tue, Jun 9, 2015 at 9:59 PM, Hans-Helge Bürger [via ownCloud] <[hidden email]> wrote:
I just tried to get this working today but I was not successful :( It seems that there is something Python and / or the developer are not telling us ^^ As soon as I got it working I will post it here.

Hans-Helge Bürger
WordPress Engineer

Telefon: +49 1579 2349 527
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com
http://multilingualpress.profile


Am 9. Juni 2015 bei 18:48:14, rahuljain840 ([hidden email]) schrieb:

Hi Hans-Helge Bürger,

I got the same error but this time with C#, Have you resolved this issue ?
If you have resolved this can you please share your code so that i can where
am i doing wrong ?

Thanks in advance.



--
View this message in context: http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15230.html
Sent from the Developers mailing list archive at Nabble.com.
_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel



If you reply to this email, your message will be added to the discussion below:
http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15231.html
To unsubscribe from Problems with Chunked upload, click here.
NAML

Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Jos Poortvliet
On Tuesday 09 June 2015 09:59:57 rahuljain840 wrote:
> Thanks for your quick reply.
>
> Seems like no one has ever used chunk uploading with any other language
> then Phython. Also the code on github is also not the officials. OwnCloud
> has not provided its proper documentation like any other storage provides
> like dropbox or skydive.

Sorry for that, we depend on volunteers quite a bit more than they do ;-)

If you figure it out, consider contributing documentation for others who bump
into the same issue...

/J

> On Tue, Jun 9, 2015 at 9:59 PM, Hans-Helge Bürger [via ownCloud] <
>
> [hidden email]> wrote:
> > I just tried to get this working today but I was not successful :( It
> > seems that there is something Python and / or the developer are not
> > telling
> > us ^^ As soon as I got it working I will post it here.
> >
> >   *Hans-Helge Bürger*
> >
> > *WordPress Engineer*
> >
> > Telefon: +49 1579 2349 527
> > E-Mail: [hidden email]
> > <http:///user/SendEmail.jtp?type=node&node=15231&i=0>
> > GnuPG keygen: h.buerger@...
> > <http://pgp.mit.edu/pks/lookup?op=get&search=0xA6AAD494C4B32F1C>
> >
> >  <http://mailto:h.buerger@...>
> >  
> >  *Inpsyde GmbH*
> >
> > Mutzer Heide 3
> > 51467 Bergisch Gladbach
> >
> > Amtsgericht Köln HRB 65224
> > Steueridentnr.: DE263849534
> > Geschäftsführer: Heinz Rohé
> >
> > http://inpsyde.com
> > http://wpde.org
> > http://edupress.de
> > http://marketpress.com
> > http://multilingualpress.profile <http://multilingualpress.pro>
> >
> > Am 9. Juni 2015 bei 18:48:14, rahuljain840 ([hidden email]
> > <http:///user/SendEmail.jtp?type=node&node=15231&i=1>) schrieb:
> >
> > Hi Hans-Helge Bürger,
> >
> > I got the same error but this time with C#, Have you resolved this issue ?
> > If you have resolved this can you please share your code so that i can
> > where
> > am i doing wrong ?
> >
> > Thanks in advance.
> >
> >
> >
> > --
> > View this message in context:
> > http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p1
> > 5230.html Sent from the Developers mailing list archive at Nabble.com.
> > _______________________________________________
> > Devel mailing list
> > [hidden email] <http:///user/SendEmail.jtp?type=node&node=15231&i=2>
> > http://mailman.owncloud.org/mailman/listinfo/devel
> >
> >
> > _______________________________________________
> > Devel mailing list
> > [hidden email] <http:///user/SendEmail.jtp?type=node&node=15231&i=3>
> > http://mailman.owncloud.org/mailman/listinfo/devel
> >
> >
> > ------------------------------
> >
> >  If you reply to this email, your message will be added to the discussion
> >
> > below:
> >
> > http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p1
> > 5231.html>
> >  To unsubscribe from Problems with Chunked upload, click here
> >
> > <http://owncloud.10557.n7.nabble.com/template/NamlServlet.jtp?macro=unsubs
> > cribe_by_code&node=15106&code=cmFodWxqYWluODQwQGdtYWlsLmNvbXwxNTEwNnwxNjAw
> > Njg5NjAz> .
> > NAML
> > <http://owncloud.10557.n7.nabble.com/template/NamlServlet.jtp?macro=macro_
> > viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.B
> > asicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.tem
> > plate.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-i
> > nstant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.na
> > ml>
> --
> View this message in context:
> http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15
> 232.html Sent from the Developers mailing list archive at Nabble.com.
--
Disclaimer:
Everything I do and say is based on my view of the world today. I am not
responsible for changes in the world, nor my view on it. Everything I say is
meant in a positive and friendly way, unless explicitly stated otherwise.
find me on blog.jospoortvliet.com
--
Disclaimer:
Everything I do and say is based on my view of the world today. I am not
responsible for changes in the world, nor my view on it. Everything I say is
meant in a positive and friendly way, unless explicitly stated otherwise.
find me on blog.jospoortvliet.com

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

signature.asc (188 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Klaas Freitag-3
In reply to this post by rahuljain840
On 09.06.2015 18:59, rahuljain840 wrote:
> Thanks for your quick reply.
>
> Seems like no one has ever used chunk uploading with any other language
> then Phython.
Oh yes, we have.... in C++ for example. Every language that can do HTTP
requests can implement the big file chunking.

> Also the code on github is also not the officials. OwnCloud
> has not provided its proper documentation like any other storage provides
> like dropbox or skydive.
Here is documentation:
https://github.com/owncloud/core/wiki/spec:-big-file-chunking

If that is not complete, please refer to the sources available in
github.com/owncloud/client or pyocclient and help extending the docs.

Thanks,

Klaas

>
> On Tue, Jun 9, 2015 at 9:59 PM, Hans-Helge Bürger [via ownCloud] <
> [hidden email]> wrote:
>
>> I just tried to get this working today but I was not successful :( It
>> seems that there is something Python and / or the developer are not telling
>> us ^^ As soon as I got it working I will post it here.
>>
>>    *Hans-Helge Bürger*
>> *WordPress Engineer*
>>
>> Telefon: +49 1579 2349 527
>> E-Mail: [hidden email]
>> <http:///user/SendEmail.jtp?type=node&node=15231&i=0>
>> GnuPG keygen: h.buerger@...
>> <http://pgp.mit.edu/pks/lookup?op=get&search=0xA6AAD494C4B32F1C>
>>   <http://mailto:h.buerger@...>
>>
>>   *Inpsyde GmbH*
>> Mutzer Heide 3
>> 51467 Bergisch Gladbach
>>
>> Amtsgericht Köln HRB 65224
>> Steueridentnr.: DE263849534
>> Geschäftsführer: Heinz Rohé
>>
>> http://inpsyde.com
>> http://wpde.org
>> http://edupress.de
>> http://marketpress.com
>> http://multilingualpress.profile <http://multilingualpress.pro>
>>
>> Am 9. Juni 2015 bei 18:48:14, rahuljain840 ([hidden email]
>> <http:///user/SendEmail.jtp?type=node&node=15231&i=1>) schrieb:
>>
>> Hi Hans-Helge Bürger,
>>
>> I got the same error but this time with C#, Have you resolved this issue ?
>> If you have resolved this can you please share your code so that i can
>> where
>> am i doing wrong ?
>>
>> Thanks in advance.
>>
>>
>>
>> --
>> View this message in context:
>> http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15230.html
>> Sent from the Developers mailing list archive at Nabble.com.
>> _______________________________________________
>> Devel mailing list
>> [hidden email] <http:///user/SendEmail.jtp?type=node&node=15231&i=2>
>> http://mailman.owncloud.org/mailman/listinfo/devel
>>
>>
>> _______________________________________________
>> Devel mailing list
>> [hidden email] <http:///user/SendEmail.jtp?type=node&node=15231&i=3>
>> http://mailman.owncloud.org/mailman/listinfo/devel
>>
>>
>> ------------------------------
>>   If you reply to this email, your message will be added to the discussion
>> below:
>>
>> http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15231.html
>>   To unsubscribe from Problems with Chunked upload, click here
>> <
>> .
>> NAML
>> <
http://owncloud.10557.n7.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
>
>
>
> --
> View this message in context: http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15232.html
> Sent from the Developers mailing list archive at Nabble.com.
>
>
>
> _______________________________________________
> Devel mailing list
> [hidden email]
> http://mailman.owncloud.org/mailman/listinfo/devel
>

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

David A. Velasco


El 11/06/2015 a las 14:18, Klaas Freitag escribió:
> On 09.06.2015 18:59, rahuljain840 wrote:
>> Thanks for your quick reply.
>>
>> Seems like no one has ever used chunk uploading with any other language
>> then Phython.
> Oh yes, we have.... in C++ for example. Every language that can do
> HTTP requests can implement the big file chunking.

For other example in Java you can check the code of
resources/files/ChunkedUploadRemoteFileOperation.java in the ownCloud
libary for Android, in https://github.com/owncloud/android-library .

>
>> Also the code on github is also not the officials. OwnCloud
>> has not provided its proper documentation like any other storage
>> provides
>> like dropbox or skydive.
> Here is documentation:
> https://github.com/owncloud/core/wiki/spec:-big-file-chunking
>
> If that is not complete, please refer to the sources available in
> github.com/owncloud/client or pyocclient and help extending the docs.
>
> Thanks,
>
> Klaas
>
>>
>> On Tue, Jun 9, 2015 at 9:59 PM, Hans-Helge Bürger [via ownCloud] <
>> [hidden email]> wrote:
>>
>>> I just tried to get this working today but I was not successful :( It
>>> seems that there is something Python and / or the developer are not
>>> telling
>>> us ^^ As soon as I got it working I will post it here.
>>>
>>>    *Hans-Helge Bürger*
>>> *WordPress Engineer*
>>>
>>> Telefon: +49 1579 2349 527
>>> E-Mail: [hidden email]
>>> <http:///user/SendEmail.jtp?type=node&node=15231&i=0>
>>> GnuPG keygen: h.buerger@...
>>> <http://pgp.mit.edu/pks/lookup?op=get&search=0xA6AAD494C4B32F1C>
>>>   <http://mailto:h.buerger@...>
>>>
>>>   *Inpsyde GmbH*
>>> Mutzer Heide 3
>>> 51467 Bergisch Gladbach
>>>
>>> Amtsgericht Köln HRB 65224
>>> Steueridentnr.: DE263849534
>>> Geschäftsführer: Heinz Rohé
>>>
>>> http://inpsyde.com
>>> http://wpde.org
>>> http://edupress.de
>>> http://marketpress.com
>>> http://multilingualpress.profile <http://multilingualpress.pro>
>>>
>>> Am 9. Juni 2015 bei 18:48:14, rahuljain840 ([hidden email]
>>> <http:///user/SendEmail.jtp?type=node&node=15231&i=1>) schrieb:
>>>
>>> Hi Hans-Helge Bürger,
>>>
>>> I got the same error but this time with C#, Have you resolved this
>>> issue ?
>>> If you have resolved this can you please share your code so that i can
>>> where
>>> am i doing wrong ?
>>>
>>> Thanks in advance.
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15230.html 
>>>
>>> Sent from the Developers mailing list archive at Nabble.com.
>>> _______________________________________________
>>> Devel mailing list
>>> [hidden email] <http:///user/SendEmail.jtp?type=node&node=15231&i=2>
>>> http://mailman.owncloud.org/mailman/listinfo/devel
>>>
>>>
>>> _______________________________________________
>>> Devel mailing list
>>> [hidden email] <http:///user/SendEmail.jtp?type=node&node=15231&i=3>
>>> http://mailman.owncloud.org/mailman/listinfo/devel
>>>
>>>
>>> ------------------------------
>>>   If you reply to this email, your message will be added to the
>>> discussion
>>> below:
>>>
>>> http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15231.html 
>>>
>>>   To unsubscribe from Problems with Chunked upload, click here
>>> <
>>>
>>> .
>>> NAML
>>> <
http://owncloud.10557.n7.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>>
>>>
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15232.html
>> Sent from the Developers mailing list archive at Nabble.com.
>>
>>
>>
>> _______________________________________________
>> Devel mailing list
>> [hidden email]
>> http://mailman.owncloud.org/mailman/listinfo/devel
>>
>
> _______________________________________________
> Devel mailing list
> [hidden email]
> http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Markus Goetz
In reply to this post by Klaas Freitag-3
On 11/06/15 14:18, Klaas Freitag wrote:
>
> If that is not complete, please refer to the sources available in
> github.com/owncloud/client or pyocclient and help extending the docs.
... direct link to the relevant file:
http://code.woboq.org/owncloud/client/src/libsync/propagateupload.cpp.html#389

--
Woboq GmbH | http://woboq.com/
Geschäftsführer: Markus Goetz, Olivier Goffart
Hermannstr. 134, 12051 Berlin, Germany
Handelsregister: Amtsgericht Berlin (Charlottenburg) HRB 137795

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Hans-Helge Bürger
I just took a look at the owncloud client and first impression: There are a lot of things done which are never mentioned before. However my client still does not work. But I have some questions you hopefully can answer :)

1. etag

The specs (https://github.com/owncloud/core/wiki/spec:-big-file-chunking) mentions etags at the end. With each response of a chunk I get a new etag. The client checks for that (https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L439) but this did not work for me so far. So my question. Is it a bad thing that I get etags returned and do I need If-Match in my header?

2. X-OC-MTIME

I saw some clients using X-OC-MTIME as header. What does this header mean?

3. Checksum

The owncloud client also adds a checksum to the last request. Is this necessary? If yes how do I calculate that?


Hans-Helge Bürger
WordPress Engineer

Telefon: +49 1579 2349 527
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com
http://multilingualpress.profile


Am 12. Juni 2015 bei 15:16:34, Markus Goetz ([hidden email]) schrieb:

On 11/06/15 14:18, Klaas Freitag wrote:
>
> If that is not complete, please refer to the sources available in
> github.com/owncloud/client or pyocclient and help extending the docs.
... direct link to the relevant file:
http://code.woboq.org/owncloud/client/src/libsync/propagateupload.cpp.html#389

--
Woboq GmbH | http://woboq.com/
Geschäftsführer: Markus Goetz, Olivier Goffart
Hermannstr. 134, 12051 Berlin, Germany
Handelsregister: Amtsgericht Berlin (Charlottenburg) HRB 137795

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Klaas Freitag-3
On 15.06.2015 09:56, Hans-Helge Bürger wrote:

Hi,

> I just took a look at the owncloud client and first impression: There
> are a lot of things done which are never mentioned before. However my
> client still does not work. But I have some questions you hopefully can
> answer :)
>
> 1. etag
>
> The specs
> (https://github.com/owncloud/core/wiki/spec:-big-file-chunking) mentions
> etags at the end. With each response of a chunk I get a new etag.
> The client checks for that
> (https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L439)
> but this did not work for me so far. So my question. Is it a bad thing
> that I get etags returned and do I need If-Match in my header?

That does not sound correct.

The ETag comes with the reply of the last chunk. The client uses it as
an indicator that the upload is finished.

Do you set the header 'OC-Chunked' in all the chunk put requests?


> 2. X-OC-MTIME
>
> I saw some clients using X-OC-MTIME as header. What does this header mean?
> https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L426

If the oc-mtime header is set, the server reads the modification time
from it and sets it on the target file. This header should be defined.


> 3. Checksum
>
> The owncloud client also adds a checksum to the last request. Is this
> necessary? If yes how do I calculate that?
No, skip the checksum for now. This might become important in the future.

Good luck,

Klaas

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

rahuljain840
In reply to this post by Hans-Helge Bürger
Hi Hans-Helge Burger,

Did you get the solution for file upload. I have tried each and everything suggested in forum and everywhere but didn't get success. The problem that i faced is that each time my chunk is submitted as a file and overwrite the previous chunk. Even i can download the chunk with the version history. It seems like magic file doesn't work and It doesn't understand the chunk request. If you have the solution Kindly share. 

Thanks in advance. 

On Mon, Jun 15, 2015 at 1:05 PM, Hans-Helge Bürger [via ownCloud] <[hidden email]> wrote:
I just took a look at the owncloud client and first impression: There are a lot of things done which are never mentioned before. However my client still does not work. But I have some questions you hopefully can answer :)

1. etag

The specs (https://github.com/owncloud/core/wiki/spec:-big-file-chunking) mentions etags at the end. With each response of a chunk I get a new etag. The client checks for that (https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L439) but this did not work for me so far. So my question. Is it a bad thing that I get etags returned and do I need If-Match in my header?

2. X-OC-MTIME

I saw some clients using X-OC-MTIME as header. What does this header mean?

3. Checksum

The owncloud client also adds a checksum to the last request. Is this necessary? If yes how do I calculate that?


Hans-Helge Bürger
WordPress Engineer

Telefon: +49 1579 2349 527
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com
http://multilingualpress.profile


Am 12. Juni 2015 bei 15:16:34, Markus Goetz ([hidden email]) schrieb:

On 11/06/15 14:18, Klaas Freitag wrote:
>
> If that is not complete, please refer to the sources available in
> github.com/owncloud/client or pyocclient and help extending the docs.
... direct link to the relevant file:
http://code.woboq.org/owncloud/client/src/libsync/propagateupload.cpp.html#389

--
Woboq GmbH | http://woboq.com/
Geschäftsführer: Markus Goetz, Olivier Goffart
Hermannstr. 134, 12051 Berlin, Germany
Handelsregister: Amtsgericht Berlin (Charlottenburg) HRB 137795

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel



If you reply to this email, your message will be added to the discussion below:
http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15263.html
To unsubscribe from Problems with Chunked upload, click here.
NAML

Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Hans-Helge Bürger
Unfortunately, my chunk upload is also not working. Magic Files also don’t work for me. I have the problem, that a new file is created with the chunk-file-name but each file hast no content (so size 0 bytes). That is totally weird :(

Hans-Helge Bürger
WordPress Engineer

Telefon: +49 2202 817 90-27
Fax: +49 2202 817 90-99
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com


Am 20. Juni 2015 bei 15:15:37, rahuljain840 ([hidden email]) schrieb:

Hi Hans-Helge Burger,

Did you get the solution for file upload. I have tried each and everything suggested in forum and everywhere but didn't get success. The problem that i faced is that each time my chunk is submitted as a file and overwrite the previous chunk. Even i can download the chunk with the version history. It seems like magic file doesn't work and It doesn't understand the chunk request. If you have the solution Kindly share. 

Thanks in advance. 

On Mon, Jun 15, 2015 at 1:05 PM, Hans-Helge Bürger [via ownCloud] <[hidden email]> wrote:
I just took a look at the owncloud client and first impression: There are a lot of things done which are never mentioned before. However my client still does not work. But I have some questions you hopefully can answer :)

1. etag

The specs (https://github.com/owncloud/core/wiki/spec:-big-file-chunking) mentions etags at the end. With each response of a chunk I get a new etag. The client checks for that (https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L439) but this did not work for me so far. So my question. Is it a bad thing that I get etags returned and do I need If-Match in my header?

2. X-OC-MTIME

I saw some clients using X-OC-MTIME as header. What does this header mean?

3. Checksum

The owncloud client also adds a checksum to the last request. Is this necessary? If yes how do I calculate that?


Hans-Helge Bürger
WordPress Engineer

Telefon: +49 1579 2349 527
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com
http://multilingualpress.profile


Am 12. Juni 2015 bei 15:16:34, Markus Goetz ([hidden email]) schrieb:

On 11/06/15 14:18, Klaas Freitag wrote:
>
> If that is not complete, please refer to the sources available in
> github.com/owncloud/client or pyocclient and help extending the docs.
... direct link to the relevant file:
http://code.woboq.org/owncloud/client/src/libsync/propagateupload.cpp.html#389

--
Woboq GmbH | http://woboq.com/
Geschäftsführer: Markus Goetz, Olivier Goffart
Hermannstr. 134, 12051 Berlin, Germany
Handelsregister: Amtsgericht Berlin (Charlottenburg) HRB 137795

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel



If you reply to this email, your message will be added to the discussion below:
http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15263.html
To unsubscribe from Problems with Chunked upload, click here.
NAML



View this message in context: Re: Problems with Chunked upload
Sent from the Developers mailing list archive at Nabble.com.
_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

rahuljain840

Hi,

Can you please share the demo of your code that you have used for chunk uploading. Might be we may miss something that is necessary for chunking.

Thanks

On Jun 23, 2015 1:31 AM, "Hans-Helge Bürger" <[hidden email]> wrote:
Unfortunately, my chunk upload is also not working. Magic Files also don’t work for me. I have the problem, that a new file is created with the chunk-file-name but each file hast no content (so size 0 bytes). That is totally weird :(

Hans-Helge Bürger
WordPress Engineer

Telefon: +49 2202 817 90-27
Fax: +49 2202 817 90-99
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com


Am 20. Juni 2015 bei 15:15:37, rahuljain840 ([hidden email]) schrieb:

Hi Hans-Helge Burger,

Did you get the solution for file upload. I have tried each and everything suggested in forum and everywhere but didn't get success. The problem that i faced is that each time my chunk is submitted as a file and overwrite the previous chunk. Even i can download the chunk with the version history. It seems like magic file doesn't work and It doesn't understand the chunk request. If you have the solution Kindly share. 

Thanks in advance. 

On Mon, Jun 15, 2015 at 1:05 PM, Hans-Helge Bürger [via ownCloud] <[hidden email]> wrote:
I just took a look at the owncloud client and first impression: There are a lot of things done which are never mentioned before. However my client still does not work. But I have some questions you hopefully can answer :)

1. etag

The specs (https://github.com/owncloud/core/wiki/spec:-big-file-chunking) mentions etags at the end. With each response of a chunk I get a new etag. The client checks for that (https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L439) but this did not work for me so far. So my question. Is it a bad thing that I get etags returned and do I need If-Match in my header?

2. X-OC-MTIME

I saw some clients using X-OC-MTIME as header. What does this header mean?

3. Checksum

The owncloud client also adds a checksum to the last request. Is this necessary? If yes how do I calculate that?


Hans-Helge Bürger
WordPress Engineer

Telefon: +49 1579 2349 527
E-Mail: [hidden email]
GnuPG keygen: h.buerger@...

Inpsyde GmbH
Mutzer Heide 3
51467 Bergisch Gladbach

Amtsgericht Köln HRB 65224
Steueridentnr.: DE263849534
Geschäftsführer: Heinz Rohé

http://inpsyde.com
http://wpde.org
http://edupress.de
http://marketpress.com
http://multilingualpress.profile


Am 12. Juni 2015 bei 15:16:34, Markus Goetz ([hidden email]) schrieb:

On 11/06/15 14:18, Klaas Freitag wrote:
>
> If that is not complete, please refer to the sources available in
> github.com/owncloud/client or pyocclient and help extending the docs.
... direct link to the relevant file:
http://code.woboq.org/owncloud/client/src/libsync/propagateupload.cpp.html#389

--
Woboq GmbH | http://woboq.com/
Geschäftsführer: Markus Goetz, Olivier Goffart
Hermannstr. 134, 12051 Berlin, Germany
Handelsregister: Amtsgericht Berlin (Charlottenburg) HRB 137795

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel



If you reply to this email, your message will be added to the discussion below:
http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15263.html
To unsubscribe from Problems with Chunked upload, click here.
NAML



View this message in context: Re: Problems with Chunked upload
Sent from the Developers mailing list archive at Nabble.com.
_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel


_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel
Reply | Threaded
Open this post in threaded view
|

Re: Problems with Chunked upload

Klaas Freitag-3
On 23.06.2015 18:06, RAHUL JAIN wrote:
> Hi,
>
> Can you please share the demo of your code that you have used for chunk
> uploading. Might be we may miss something that is necessary for chunking.

Best would be if you could share a mitmproxy dump or a wireshark report
where we see the http requests that go back and forth. That way we can
see whats going wrong.

Klaas


>
> On Jun 23, 2015 1:31 AM, "Hans-Helge Bürger" <[hidden email]
> <mailto:[hidden email]>> wrote:
>
>     Unfortunately, my chunk upload is also not working. Magic Files also
>     don’t work for me. I have the problem, that a new file is created
>     with the chunk-file-name but each file hast no content (so size 0
>     bytes). That is totally weird :(
>
>     *Hans-Helge Bürger*
>     /WordPress Engineer/
>
>     Telefon: +49 2202 817 90-27
>     Fax: +49 2202 817 90-99
>     E-Mail: [hidden email] <mailto:[hidden email]>
>     GnuPG keygen: [hidden email]
>     <http://pgp.mit.edu/pks/lookup?op=get&search=0xA6AAD494C4B32F1C>
>
>     <http://mailto:h.buerger@...>
>
>     *Inpsyde GmbH*
>     Mutzer Heide 3
>     51467 Bergisch Gladbach
>
>     Amtsgericht Köln HRB 65224
>     Steueridentnr.: DE263849534
>     Geschäftsführer: Heinz Rohé
>
>     http://inpsyde.com
>     http://wpde.org
>     http://edupress.de
>     http://marketpress.com
>
>
>     Am 20. Juni 2015 bei 15:15:37, rahuljain840 ([hidden email]
>     <mailto:[hidden email]>) schrieb:
>
>>     Hi Hans-Helge Burger,
>>
>>     Did you get the solution for file upload. I have tried each and
>>     everything suggested in forum and everywhere but didn't get
>>     success. The problem that i faced is that each time my chunk is
>>     submitted as a file and overwrite the previous chunk. Even i can
>>     download the chunk with the version history. It seems like magic
>>     file doesn't work and It doesn't understand the chunk request. If
>>     you have the solution Kindly share.
>>
>>     Thanks in advance.
>>
>>     On Mon, Jun 15, 2015 at 1:05 PM, Hans-Helge Bürger [via ownCloud]
>>     <[hidden email]
>>     <http:///user/SendEmail.jtp?type=node&node=15294&i=0>> wrote:
>>
>>         I just took a look at the owncloud client and first
>>         impression: There are a lot of things done which are never
>>         mentioned before. However my client still does not work. But I
>>         have some questions you hopefully can answer :)
>>
>>         1. etag
>>
>>         The specs
>>         (https://github.com/owncloud/core/wiki/spec:-big-file-chunking) mentions
>>         etags at the end. With each response of a chunk I get a new
>>         etag. The client checks for that
>>         (https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L439)
>>         but this did not work for me so far. So my question. Is it a
>>         bad thing that I get etags returned and do I need If-Match in
>>         my header?
>>
>>         2. X-OC-MTIME
>>
>>         I saw some clients using X-OC-MTIME as header. What does this
>>         header mean?
>>         https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L426
>>
>>         3. Checksum
>>
>>         The owncloud client also adds a checksum to the last request.
>>         Is this necessary? If yes how do I calculate that?
>>         https://github.com/owncloud/client/blob/master/src%2Flibsync%2Fpropagateupload.cpp#L468
>>
>>
>>         *Hans-Helge Bürger*
>>         /WordPress Engineer/
>>
>>         Telefon: +49 1579 2349 527
>>         E-Mail: [hidden email]
>>         <http:///user/SendEmail.jtp?type=node&node=15263&i=0>
>>         GnuPG keygen: h.buerger@...
>>         <http://pgp.mit.edu/pks/lookup?op=get&search=0xA6AAD494C4B32F1C>
>>
>>         <http://mailto:h.buerger@...>
>>
>>         *Inpsyde GmbH*
>>         Mutzer Heide 3
>>         51467 Bergisch Gladbach
>>
>>         Amtsgericht Köln HRB 65224
>>         Steueridentnr.: DE263849534
>>         Geschäftsführer: Heinz Rohé
>>
>>         http://inpsyde.com
>>         http://wpde.org
>>         http://edupress.de
>>         http://marketpress.com
>>         http://multilingualpress.profile <http://multilingualpress.pro>
>>
>>
>>         Am 12. Juni 2015 bei 15:16:34, Markus Goetz ([hidden email]
>>         <http:///user/SendEmail.jtp?type=node&node=15263&i=1>) schrieb:
>>
>>>         On 11/06/15 14:18, Klaas Freitag wrote:
>>>         >
>>>         > If that is not complete, please refer to the sources available in
>>>         > github.com/owncloud/client
>>>         <http://github.com/owncloud/client> or pyocclient and help
>>>         extending the docs.
>>>         ... direct link to the relevant file:
>>>         http://code.woboq.org/owncloud/client/src/libsync/propagateupload.cpp.html#389
>>>
>>>         --
>>>         Woboq GmbH | http://woboq.com/
>>>         Geschäftsführer: Markus Goetz, Olivier Goffart
>>>         Hermannstr. 134, 12051 Berlin, Germany
>>>         Handelsregister: Amtsgericht Berlin (Charlottenburg) HRB 137795
>>>
>>>         _______________________________________________
>>>         Devel mailing list
>>>         [hidden email]
>>>         <http:///user/SendEmail.jtp?type=node&node=15263&i=2>
>>>         http://mailman.owncloud.org/mailman/listinfo/devel
>>
>>         _______________________________________________
>>         Devel mailing list
>>         [hidden email]
>>         <http:///user/SendEmail.jtp?type=node&node=15263&i=3>
>>         http://mailman.owncloud.org/mailman/listinfo/devel
>>
>>
>>         ------------------------------------------------------------------------
>>         If you reply to this email, your message will be added to the
>>         discussion below:
>>         http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15263.html
>>         To unsubscribe from Problems with Chunked upload, click here.
>>         NAML
>>         <http://owncloud.10557.n7.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>>
>>
>>     ------------------------------------------------------------------------
>>     View this message in context: Re: Problems with Chunked upload
>>     <http://owncloud.10557.n7.nabble.com/Problems-with-Chunked-upload-tp15106p15294.html>
>>     Sent from the Developers mailing list archive
>>     <http://owncloud.10557.n7.nabble.com/Developers-f11902.html> at
>>     Nabble.com.
>>     _______________________________________________
>>     Devel mailing list
>>     [hidden email] <mailto:[hidden email]>
>>     http://mailman.owncloud.org/mailman/listinfo/devel
>
>     _______________________________________________
>     Devel mailing list
>     [hidden email] <mailto:[hidden email]>
>     http://mailman.owncloud.org/mailman/listinfo/devel
>
>
>
> _______________________________________________
> Devel mailing list
> [hidden email]
> http://mailman.owncloud.org/mailman/listinfo/devel
>

_______________________________________________
Devel mailing list
[hidden email]
http://mailman.owncloud.org/mailman/listinfo/devel