Difference between revisions of "2017 Winter Project Week/IPFS NoSQL Combination"
From NAMIC Wiki
(7 intermediate revisions by 2 users not shown) | |||
Line 8: | Line 8: | ||
* Hans Meine (University of Bremen, Fraunhofer MEVIS = FME) | * Hans Meine (University of Bremen, Fraunhofer MEVIS = FME) | ||
* Steve Pieper (Isomics) | * Steve Pieper (Isomics) | ||
+ | * Satra Ghosh | ||
==Project Description== | ==Project Description== | ||
Line 30: | Line 31: | ||
<!-- Progress and Next steps bullet points (fill out at the end of project week) --> | <!-- Progress and Next steps bullet points (fill out at the end of project week) --> | ||
* IPFS stability and status | * IPFS stability and status | ||
− | ** 0.4.4 provided as binaries (recommended installation, very simple) | + | ** 0.4.4 [https://ipfs.io/docs/install/ provided as binaries] (recommended installation, very simple) |
** 0.4.4 [https://github.com/ipfs/go-ipfs/issues/3250 does not play well with up-to-date FUSE for macOS yet] | ** 0.4.4 [https://github.com/ipfs/go-ipfs/issues/3250 does not play well with up-to-date FUSE for macOS yet] | ||
** performance when listing directories not available on current machine is not good (several seconds delay) | ** performance when listing directories not available on current machine is not good (several seconds delay) | ||
+ | * Performed several experiments that showed disappointing performance (maybe MIT wifi related?), but eventually successful transfers | ||
+ | * QmPyXW927iBPHVk3hfyzXAPGDpup26WGEh4LYK6da2xMhA is a TCGA subdirectory transferred to several project week participants' computers | ||
+ | * Discussed interesting deduplication idea: Can original DICOM, anonymized DICOM and e.g. Nifty files share data blocks? | ||
+ | ** Answer: Yes, there's a <code>--chunker</code> argument to <code>ipfs add</code> which [https://github.com/ipfs/faq/issues/214 defines the chunking algorithm]. Apparently, the rabin chunker should already perform well, without any particular knowledge about the file formats, but it does not seem to be the default algorithm. (Valid arguments include: 'rabin' 'rabin-[avg]' or 'rabin-[min]-[avg]-[max]' with integer parameters.) | ||
+ | ** Also pay attention to development of IPLD (for example: [https://github.com/ipld/specs/tree/master/ipld#format-definition look here]) | ||
|} | |} | ||
Line 43: | Line 49: | ||
** http://academictorrents.com/ | ** http://academictorrents.com/ | ||
** https://webtorrent.io/ | ** https://webtorrent.io/ | ||
+ | * PIP package: <code>pip install ipfsapi</code> |
Latest revision as of 14:56, 13 January 2017
Home < 2017 Winter Project Week < IPFS NoSQL CombinationKey Investigators
- Hans Meine (University of Bremen, Fraunhofer MEVIS = FME)
- Steve Pieper (Isomics)
- Satra Ghosh
Project Description
Objective | Approach and Plan | Progress and Next Steps |
---|---|---|
|
|
|
Background and References
- IPFS homepage https://ipfs.io
- "Private Networks - First Implementation" issue: https://github.com/ipfs/go-ipfs/issues/3313
- Chronicle: https://github.com/pieper/Chronicle
- Also reconsider if BitTorrent or similar technologies can help here
- PIP package:
pip install ipfsapi