Rocksolid Light

News from da outaworlds

mail  files  register  groups  login

Message-ID:  

You will forget that you ever knew me.

comp / comp.os.linux.misc / Re: Distributed CoW file systems

SubjectAuthor
* Distributed CoW file systemsGerhard Strangar
+* Re: Distributed CoW file systemscandycanearter07
|`* Re: Distributed CoW file systemsBorax Man
| `- Re: Distributed CoW file systemsGerhard Strangar
`- Re: Distributed CoW file systemsLawrence D'Oliveiro

1
Subject: Distributed CoW file systems
From: Gerhard Strangar
Newsgroups: comp.os.linux.misc
Date: Sat, 1 Jun 2024 18:07 UTC
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: g.s@arcor.de (Gerhard Strangar)
Newsgroups: comp.os.linux.misc
Subject: Distributed CoW file systems
Date: Sat, 1 Jun 2024 18:07:13 +0000
Lines: 14
Message-ID: <lc16ahF85smU1@mid.individual.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Trace: individual.net Bn2BNcZlq39pgwA8Je24aglsbaSrkMMwnbQrMD8JWm9YFo0hfw
Cancel-Lock: sha1:WCbLff0aKSUqKSSxpJSdQ5SyBCE= sha256:aP1/SlnoSUgKFV162y9FV23Cf11CMq2UL6hYohqz3f0=
X-Mozilla-News-Host: snews://news.individual.de:563
X-No-Archive: Yes
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101
Firefox/91.0 SeaMonkey/2.53.18.2
View all headers

Hello,

I'm looking for a file system that can be mounted on a Linux client and
that is being distributed among multiple servers like a RAID 0. However,
I'd like it to have file system snapshots and the possibility to grow by
adding additional servers. I know BeeGFS, but it's lacking the
snapshots. I know ZFS, but it's lacking the ability to be spread across
multiple servers.
Can you recommend somthing combining those two? It does not need to be
free of charge, but it needs to work reliably.

Thanks,
Gerhard

Subject: Re: Distributed CoW file systems
From: Lawrence D'Oliv
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Sun, 2 Jun 2024 01:16 UTC
References: 1
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: ldo@nz.invalid (Lawrence D'Oliveiro)
Newsgroups: comp.os.linux.misc
Subject: Re: Distributed CoW file systems
Date: Sun, 2 Jun 2024 01:16:42 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 9
Message-ID: <v3gh5q$31rjc$1@dont-email.me>
References: <lc16ahF85smU1@mid.individual.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Sun, 02 Jun 2024 03:16:43 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="af5b283064d4258912cb1541ae2b6f8a";
logging-data="3206764"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19hYd5wbt6IxQf+0NCh7Y63"
User-Agent: Pan/0.158 (Avdiivka; )
Cancel-Lock: sha1:r6qxrWPVPqEJ7tV5uYjsQY0zCNQ=
View all headers

On Sat, 1 Jun 2024 18:07:13 +0000, Gerhard Strangar wrote:

> I'm looking for a file system that can be mounted on a Linux client and
> that is being distributed among multiple servers like a RAID 0.

Note that RAID 0 is the opposite of what the “R” means: it actually has
*less* redundancy that JBOD. In JBOD, if one disk fails, you only lose
what’s on that disk. With RAID 0, if you lose one disk, potentially all
the data is gone.

Subject: Re: Distributed CoW file systems
From: candycanearter07
Newsgroups: comp.os.linux.misc
Organization: the-candyden-of-code
Date: Sun, 2 Jun 2024 19:05 UTC
References: 1
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: candycanearter07@candycanearter07.nomail.afraid (candycanearter07)
Newsgroups: comp.os.linux.misc
Subject: Re: Distributed CoW file systems
Date: Sun, 2 Jun 2024 19:05:03 -0000 (UTC)
Organization: the-candyden-of-code
Lines: 20
Message-ID: <slrnv5pgfg.12dl.candycanearter07@candydeb.host.invalid>
References: <lc16ahF85smU1@mid.individual.net>
Injection-Date: Sun, 02 Jun 2024 21:05:03 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="f7dc3b05d7728223b97a2d834de4ae5a";
logging-data="3665356"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX18tgIXjpy0t1LjoD7OV5TJj4DfHs1eGQK+JUBG1cV8cqQ=="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:fbll0JH2uUwpd6pqMwRuiUEdkFE=
X-Face: b{dPmN&%4|lEo,wUO\"KLEOu5N_br(N2Yuc5/qcR5i>9-!^e\.Tw9?/m0}/~:UOM:Zf]%
b+ V4R8q|QiU/R8\|G\WpC`-s?=)\fbtNc&=/a3a)r7xbRI]Vl)r<%PTriJ3pGpl_/B6!8pe\btzx
`~R! r3.0#lHRE+^Gro0[cjsban'vZ#j7,?I/tHk{s=TFJ:H?~=]`O*~3ZX`qik`b:.gVIc-[$t/e
ZrQsWJ >|l^I_[pbsIqwoz.WGA]<D
View all headers

Gerhard Strangar <g.s@arcor.de> wrote at 18:07 this Saturday (GMT):
> Hello,
>
> I'm looking for a file system that can be mounted on a Linux client and
> that is being distributed among multiple servers like a RAID 0. However,
> I'd like it to have file system snapshots and the possibility to grow by
> adding additional servers. I know BeeGFS, but it's lacking the
> snapshots. I know ZFS, but it's lacking the ability to be spread across
> multiple servers.
> Can you recommend somthing combining those two? It does not need to be
> free of charge, but it needs to work reliably.
>
> Thanks,
> Gerhard

BTRFS has RAID and snapshots. Not sure about the server part.
https://wiki.archlinux.org/title/Btrfs
--
user <candycane> is generated from /dev/urandom

Subject: Re: Distributed CoW file systems
From: Borax Man
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Mon, 3 Jun 2024 03:28 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: rotflol2@hotmail.com (Borax Man)
Newsgroups: comp.os.linux.misc
Subject: Re: Distributed CoW file systems
Date: Mon, 3 Jun 2024 03:28:36 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 36
Message-ID: <slrnv5qe33.cr9.rotflol2@geidiprime.bvh>
References: <lc16ahF85smU1@mid.individual.net>
<slrnv5pgfg.12dl.candycanearter07@candydeb.host.invalid>
Injection-Date: Mon, 03 Jun 2024 05:28:36 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="09376661fa231618202940d2baff1c6f";
logging-data="3932213"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19+TA2VlKxwtPWeul05xdCNlKuwyZgY/A8="
User-Agent: slrn/1.0.3 (Linux)
Cancel-Lock: sha1:/NVwlFAT8C4OesCCtWtF/R91C/I=
View all headers

On 2024-06-02, candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> wrote:
> Gerhard Strangar <g.s@arcor.de> wrote at 18:07 this Saturday (GMT):
>> Hello,
>>
>> I'm looking for a file system that can be mounted on a Linux client and
>> that is being distributed among multiple servers like a RAID 0. However,
>> I'd like it to have file system snapshots and the possibility to grow by
>> adding additional servers. I know BeeGFS, but it's lacking the
>> snapshots. I know ZFS, but it's lacking the ability to be spread across
>> multiple servers.
>> Can you recommend somthing combining those two? It does not need to be
>> free of charge, but it needs to work reliably.
>>
>> Thanks,
>> Gerhard
>
>
> BTRFS has RAID and snapshots. Not sure about the server part.
> https://wiki.archlinux.org/title/Btrfs

GlusterFS might be what you are looking for.

https://gluster.org/

Advantages

Scales to several petabytes
Handles thousands of clients
POSIX compatible
Uses commodity hardware
Can use any ondisk filesystem that supports extended attributes
Accessible using industry standard protocols like NFS and SMB
Provides replication, quotas, geo-replication, snapshots and bitrot detection
Allows optimization for different workloads
Open Source

Subject: Re: Distributed CoW file systems
From: Gerhard Strangar
Newsgroups: comp.os.linux.misc
Date: Mon, 3 Jun 2024 08:26 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: g.s@arcor.de (Gerhard Strangar)
Newsgroups: comp.os.linux.misc
Subject: Re: Distributed CoW file systems
Date: Mon, 3 Jun 2024 08:26:09 +0000
Lines: 12
Message-ID: <lc5d12FrccoU1@mid.individual.net>
References: <lc16ahF85smU1@mid.individual.net>
<slrnv5pgfg.12dl.candycanearter07@candydeb.host.invalid>
<slrnv5qe33.cr9.rotflol2@geidiprime.bvh>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
X-Trace: individual.net DwU+fjHScBNGYcmvaEAa5wwlCC1JucomLEMuNL0RPitePKRuMe
Cancel-Lock: sha1:dJO56nDvxMQhntSOtIItRhok58Q= sha256:PuWm1L/53hCmWpKjvfYYJemtC4Ia7Onsdwc5yNX7tK8=
X-No-Archive: Yes
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:91.0) Gecko/20100101
Firefox/91.0 SeaMonkey/2.53.18.2
In-Reply-To: <slrnv5qe33.cr9.rotflol2@geidiprime.bvh>
View all headers

Borax Man wrote:

> Accessible using industry standard protocols like NFS and SMB

That's what I need to get away from. I need more write performance than
one machine can handle, so the clients need to write to a file system
that is not accessed via a single server. Instead, clients need to write
chunks of data to every server to allow the servers to keep up with the
flow of data.

Gerhard

1

rocksolid light 0.9.8
clearnet tor