Hubic FUSE FileSystem (Read Only) Streaming mode

Hi,

Like you I was trying to mount hubic with hubicfuse to Have Large movie library with plex/emby.. etc

What is the problem of actuall hubicfuse?

when plex try to get the header of your MKV, it only try to get first 100mb, but hubicfuse before send bytes to apps, it download all file.

This issue cause that you need to wait 15, 30,60 min to see a movie in streaming.

What i'm doing?

I'm doing a new Hubic Fuse FileSystem that, only download chunks of file(20mb per chunk)

If your app require 128kb of offset 0, my app only download first 20mb, all data is saved to temporal directory, building same folder structure that hubic cloud.

If you don't acces anymore to a file prevously download (5 min) the file will be removed.

The application can download up to 10 chunks at same time. (This is good to break hubic speed limit (2mb/s x connection)

For now the application is READ ONLY, because this hubic fuse I developed only to have the posibility to do streaming.

upload streaming is very complicated but if is really needed I will should try to add this functionality.

The application is developed in java, using javafuse and jni.

I'm getting good download speeds, no cuts on streaming. but highly cpu usage, (problem with apache http connections, I will fix this in next weeks)

When I Have a stable version I allow you to Download my app.

Sorry for my bad english.

This looks pretty cool! Have you made any more progress?

Great go ahead thanks

slt

que devient ce projet hubic?

Hi people, yes the project is working perfectly, Now i cappable of see in streaming movies using Hubic through Plex.

I fixed the High CPU problem.
I added Cache Temporal(because if more than one person are seeing the same movie, system don’t try to download from hubic more than one)

And now I’m implementing Writing mode, it’s a little bit complicated, now it’s working but I have problems implementing copy & move Operations, when this two are done I will implement File Permissions and I think it’s done.

Anyway Now it’s a little bit sttoped because i have other project in my hands → See one of my problem in the new project https://forums.plex.tv/discussion/83083/rel-iptv-bundle-plugin-that-plays-iptv-streams-from-a-m3u-playlist/p36
If can yan help me, i thank you a lot if you help me

I hope before end the year I can release a stable version of this two projects to the community

Hi,

I’m really interested in your work. Could it be possible to get an early version of it ? I’ve got 4Tb of storage on my dedicated server and I thought I could bring 10Tb more with hubiC. I tried hubicfuse and I saw that it had to download the all file just to get meta information.

Thanks.

News on the functioning of Hubicfuse?
Or are there alternatives?

Short guide (works perfectly fine with plex), both streaming and uploading

Setup a swift gateway, https://github.com/jkaberg/docker-hubic2swiftgate
Install and and mount hubic with s3ql, you need to pin the self generated certificate. See s3ql docs

@jkaberg said:
Short guide (works perfectly fine with plex), both streaming and uploading

Setup a swift gateway, GitHub - jkaberg/docker-hubic2swiftgate: An docker for hubic2swiftgate
Install and and mount hubic with s3ql, you need to pin the self generated certificate. See s3ql docs

Hello
great news but I do not understand how to install
someone could make a tutorial

@jkaberg said:
Short guide (works perfectly fine with plex), both streaming and uploading

Setup a swift gateway, GitHub - jkaberg/docker-hubic2swiftgate: An docker for hubic2swiftgate
Install and and mount hubic with s3ql, you need to pin the self generated certificate. See s3ql docs

Thanks for the reply.
If it works well with Plex, a tutorial explained well would be very useful.

@pikeupe said:
someone could make a tutorial

same here im a bit new to the docker thing , no issue with the streaming ?

@jkaberg said:
Short guide (works perfectly fine with plex), both streaming and uploading

Setup a swift gateway, GitHub - jkaberg/docker-hubic2swiftgate: An docker for hubic2swiftgate
Install and and mount hubic with s3ql, you need to pin the self generated certificate. See s3ql docs

i can see you have a folder for apache , so i guess this will probably not work with nginx ?

Doing a search I found this: https://github.com/oderwat/hubic2swiftgate
And there is also talk of nginx.
I don’t know if it works well with Plex and if the tutorial is right.

I’ve tested docker-hubic2swiftgate but I’m stuck at :

You can then mount hubic2swiftgate with s3ql or similar like so,

mount.s3ql swift://localhost:9443/<bucketname> <mountpoint>

I don’t know what the bucketname is.

I’m waiting for a reply from @jkaberg .
I absolutely need something that works well in streaming.

It works well. But it’s CPU consumming. I can’t stream more than two videos with transcoding from my hubiC storage with a Xeon 1225V2.

You just have to follow the “tutorial” on https://github.com/jkaberg/docker-hubic2swiftgate.

Before being able to mount the swift drive, you have to create a file system with mkfs.s3ql swift://localhost:“port”/“container”

I use these helps to do so :

• https://dmsimard.com/2014/09/29/s3ql-a-filesystem-over-http-with-openstack-swift/
• https://bitbucket.org/nikratio/s3ql/

Don’t use the default container, use hubic instead, otherwise you’ll have plenty of s3ql.datax.bin displayed on your hubiC web user Interface. And, yes, all files uploaded on hubic on non default container will not shown. I’m looking at a way to display them via their API.

Thanks for the answer, but I don’t have a CPU powerful so I don’t think this solution is fine for me. I hope that there are others solutions.

You can save some CPU time by removing de LZH compression. However, your bandwidth’ needs will grow up.

BTW, it’s no more cpu time consumming now that i’ve removed the LZH compression.
Without transcode, CPU load is almost the same when I play from the HDD server and from hubiC.

I tried to follow the tutorial on git (https://github.com/jkaberg/docker-hubic2swiftgate), but with the command to build “docker build -t hubic2swiftgate .” This is what happens to me, is that right?