12:29 p.m.
Dear John,
this is what stratis reports after deleting about 50GB of data from
/mnt/home and about 30GB of data from /mnt/opt:
# stratis pool
Name Total / Used / Free Properties
UUID Alerts
stratis_hdd 1.43 TiB / 819.34 GiB / 645.49 GiB Ca,~Cr, Op
093c8d42-21b8-46a2-a7e8-5d35f458fa58 WS001
# stratis blockdev
Pool Name Device Node Physical Size Tier UUID
stratis_hdd /dev/dm-6 1.43 TiB DATA
9a5b1c4d-8014-4155-990e-eedfd27803a6
stratis_hdd /dev/dm-7 292.95 GiB CACHE
770d0190-c17b-4349-a9f9-0968036e6b2c
# stratis fs
Pool Filesystem Total / Used / Free / Limit
Created Device UUID
stratis_hdd home 2 TiB / 708.75 GiB / 1.31 TiB / None Apr
28 2019 12:29 /dev/stratis/stratis_hdd/home 1715
5095-e225-4fb0-b020-ec2ffa6a5e4d
stratis_hdd opt 1 TiB / 109.11 GiB / 914.89 GiB / None Apr
28 2019 12:30 /dev/stratis/stratis_hdd/opt fb19
a29e-ab39-4b41-8d37-0dc6d222a2b9
For me, it looks like there is no change on reported numbers and/or the
alert. Perhaps I misunderstood what to do?
Kind regards,
aanno
Am 13.12.23 um 05:05 schrieb stratis-devel-request(a)lists.fedorahosted.org:
Send stratis-devel mailing list submissions to
stratis-devel(a)lists.fedorahosted.org
To subscribe or unsubscribe via email, send a message with subject or
body 'help' to
stratis-devel-request(a)lists.fedorahosted.org
You can reach the person managing the list at
stratis-devel-owner(a)lists.fedorahosted.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of stratis-devel digest..."
Today's Topics:
1. Re: stratis: fs exhausted? (John Baublitz)
----------------------------------------------------------------------
Date: Tue, 12 Dec 2023 17:57:53 -0500
From: John Baublitz<jbaublit(a)redhat.com>
Subject: [stratis-devel] Re: stratis: fs exhausted?
To: aanno<aannoaanno(a)gmail.com>
Cc:stratis-devel@lists.fedorahosted.org
Message-ID:
<CANPnS0=GeO7FUb5EJpL1_2OAKVULMNFhP=efvwfNWCms83WZAg(a)mail.gmail.com>
Content-Type: multipart/alternative;
boundary="000000000000b6b959060c57fb18"
--000000000000b6b959060c57fb18
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Hi aanno,
I would also like to just mention that when you say the physical space is
exhausted, I'm assuming you're referring to alert WS001, correct? We may
need to document this a little bit better because this alert just means
that all of the space in the pool is fully allocated. This alert
specifically pops up when:
1. The pool extends to take up all available physical space (this will not
set the warning you are seeing).
2. You fill up the remaining space to the point where only 15 GiB is left.
3. The pool attempts to extend the data device further and determines there
is no space left to extend (this is when the warning is set).
Now practically what this means is that when the warning is set, you have
15GiB left of space. If you fill up the 15GiB, the pool will not be able to
be extended further to help you out. What I'm mostly curious about is,
looking at the space you reported in stratis pool/fs it looks like the
physical space on the pool is not full enough to warrant the alert. Is this
output after deleting a significant amount of data from the pool? From what
I can see, you shouldn't have this alert set unless your usage spiked
significantly and went back down. The warning doesn't clear out unless you
add more space so the state you're in is not impossible or even unlikely,
but it does make me wonder a little bit about your usage pattern. Are you
still seeing this instability even with the lower usage you pasted here?
On Thu, Dec 7, 2023 at 1:37=E2=80=AFPM aanno<aannoaanno(a)gmail.com> wrote:
> Hello,
>
> I'm using stratis for many years now (for my /home and /opt mount points)=
.
> It looks like this:
>
> $ stratis pool
> Name Total / Used / Free Properties
> UUID Alerts
> stratis_hdd 1.43 TiB / 819.51 GiB / 645.32 GiB Ca,~Cr, Op
> 093c8d42-21b8-46a2-a7e8-5d35f458fa58 WS001
>
> $ stratis fs
> Pool Filesystem Total / Used / Free / Limit
> Created Device UUID
>
> stratis_hdd home 2 TiB / 708.92 GiB / 1.31 TiB / None Apr 2=
8
> 2019 12:29 /dev/stratis/stratis_hdd/home 1715
> 5095-e225-4fb0-b020-ec2ffa6a5e4d
> stratis_hdd opt 1 TiB / 109.11 GiB / 914.89 GiB / None Apr 2=
8
> 2019 12:30 /dev/stratis/stratis_hdd/opt fb19
> a29e-ab39-4b41-8d37-0dc6d222a2b9
>
> $ stratis blockdev
> Pool Name Device Node Physical Size Tier UUID
>
> stratis_hdd /dev/dm-6 292.95 GiB CACHE
> 770d0190-c17b-4349-a9f9-0968036e6b2c
> stratis_hdd /dev/dm-7 1.43 TiB DATA
> 9a5b1c4d-8014-4155-990e-eedfd27803a6
>
> However, since a few weeks my /home has become unstable. Newly created (o=
r
> altered) files are (sometimes) corrupted after a reboot of the system.
>
> For both mount points I'm using a SSD cache in front of a HDD. It feels a
> bit like the caching layer is all right, but the HDD layer is on error
> (exhausted?). For me, it looks like that would explain the observed
> behaviour.
>
> I wonder if
>
> * I could somehow 'disable' (or remove) the SSD caching layer?
> * I could get some debug informations?
>
> Kind regards,
>
> aanno
>
> --
> _______________________________________________
> stratis-devel mailing list --stratis-devel(a)lists.fedorahosted.org
> To unsubscribe send an email tostratis-devel-leave(a)lists.fedorahosted.or=
g
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedorahosted.org/archives/list/stratis-devel@lists.fedoraho=
sted.org
> Do not reply to spam, report it:
> https://pagure.io/fedora-infrastructure/new_issue
>
--=20
John
he/him
Principal Software Engineer, Stratis team
--000000000000b6b959060c57fb18
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div dir=3D"ltr"><div>Hi
aanno,</div><div>I would also lik=
e to just mention that when you say the physical space is exhausted, I'=
m assuming you're referring to alert WS001, correct? We may need to doc=
ument this a little bit better because this alert just means that all of th=
e space in the pool is fully allocated. This alert specifically pops up whe=
n:</div><div><br></div><div>1. The pool extends to take up
all available ph=
ysical space (this will not set the warning you are seeing).</div><div>2. Y=
ou fill up the remaining space to the point where only 15 GiB is left.</div=
> <div>3. The pool attempts to extend the data device further and determines=
there is no space left to extend (this is when the warning is set).<br></d=
iv><div><br></div><div>Now practically what this means is that
when the war=
ning is set, you have 15GiB left of space. If you fill up the 15GiB, the po=
ol will not be able to be extended further to help you out. What I'm mo=
stly curious about is, looking at the space you reported in stratis pool/fs=
it looks like the physical space on the pool is not full enough to warrant=
the alert. Is this output after deleting a significant amount of data from=
the pool? From what I can see, you shouldn't have this alert set unles=
s your usage spiked significantly and went back down. The warning doesn'=
;t clear out unless you add more space so the state you're in is not im=
possible or even unlikely, but it does make me wonder a little bit about yo=
ur usage pattern. Are you still seeing this instability even with the lower=
usage you pasted here?<br></div></div><br><div
class=3D"gmail_quote"><div =
dir=3D"ltr" class=3D"gmail_attr">On Thu, Dec 7, 2023 at
1:37=E2=80=AFPM aan=
no <<a
href=3D"mailto:aannoaanno@gmail.com">aannoaanno@gmail.com</a>>=
wrote:<br></div><blockquote class=3D"gmail_quote"
style=3D"margin:0px 0px =
0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex"><u></u>
=20
=20
=20
<div>
<p>Hello,</p>
<p>I'm using stratis for many years now (for my /home and /opt moun=
t
points). It looks like this:</p>
<p><span style=3D"font-family:monospace"><span
style=3D"color:rgb(0,0,0=
);background-color:rgb(255,255,255)">$ stratis pool
</span><br>
Name =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0Total / Used / Free =C2=A0=C2=A0=C2=A0Properties
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0UUID =C2=A0=
=C2=A0Alerts
<br>
stratis_hdd =C2=A0=C2=A01.43 TiB / 819.51 GiB / 645.32 GiB =C2=A0=
=C2=A0=C2=A0Ca,~Cr, Op
=C2=A0=C2=A0093c8d42-21b8-46a2-a7e8-5d35f458fa58 =C2=A0=C2=A0WS001 =
<br>
<br>
</span><span
style=3D"font-family:monospace"></span></p>
<p><span style=3D"font-family:monospace"><span
style=3D"color:rgb(0,0,0=
);background-color:rgb(255,255,255)">$ stratis fs
</span><br>
Pool =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Filesyst=
em =C2=A0=C2=A0Total / Used / Free / Limit
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0Created =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0Device
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0UUID<br>
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
stratis_hdd =C2=A0=C2=A0home =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A02 TiB / 708.92 GiB / 1.31 TiB / None
=C2=A0=C2=A0=C2=A0=C2=A0Apr 28 2019 12:29 =C2=A0=C2=A0/dev/stratis/=
stratis_hdd/home =C2=A0=C2=A01715<br>
5095-e225-4fb0-b020-ec2ffa6a5e4d
<br>
stratis_hdd =C2=A0=C2=A0opt =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A01 TiB / 109.11 GiB / 914.89 GiB /
None =C2=A0=C2=A0Apr 28 2019 12:30 =C2=A0=C2=A0/dev/stratis/stratis=
_hdd/opt =C2=A0=C2=A0=C2=A0fb19<br>
a29e-ab39-4b41-8d37-0dc6d222a2b9<br>
<br>
</span></p>
<p><span style=3D"font-family:monospace"></span><span
style=3D"font-fam=
ily:monospace"><span
style=3D"color:rgb(0,0,0);background-color:rgb(255,255=
,255)">$ stratis
blockdev
</span><br>
Pool Name =C2=A0=C2=A0=C2=A0=C2=A0Device Node =C2=A0=C2=A0Physical =
Size =C2=A0=C2=A0=C2=A0Tier =C2=A0=C2=A0UUID
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0<br>
stratis_hdd =C2=A0=C2=A0/dev/dm-6 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0292.95 GiB =C2=A0=C2=A0CACHE
=C2=A0=C2=A0770d0190-c17b-4349-a9f9-0968036e6b2c
<br>
stratis_hdd =C2=A0=C2=A0/dev/dm-7 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A01.43 TiB =C2=A0=C2=A0=C2=A0DATA
=C2=A0=C2=A09a5b1c4d-8014-4155-990e-eedfd27803a6<br>
</span><br>
</p>
<p>However, since a few weeks my /home has become unstable. Newly
created (or altered) files are (sometimes) corrupted after a
reboot of the system.</p>
<p>For both mount points I'm using a SSD cache in front of a HDD. I=
t
feels a bit like the caching layer is all right, but the HDD layer
is on error (exhausted?). For me, it looks like that would explain
the observed behaviour.</p>
<p>I wonder if</p>
<p>* I could somehow 'disable' (or remove) the SSD caching
laye=
r?<br>
* I could get some debug informations?<br>
</p>
<p>Kind regards,</p>
<p>aanno<br>
</p>
<p><span
style=3D"font-family:monospace"></span></p>
</div>
--<br>
_______________________________________________<br>
stratis-devel mailing list -- <a href=3D"mailto:stratis-devel@lists.fedorah=
osted.org"
target=3D"_blank">stratis-devel(a)lists.fedorahosted.org</a><br>
To unsubscribe send an email to <a href=3D"mailto:stratis-devel-leave@lists=
.fedorahosted.org"
target=3D"_blank">stratis-devel-leave(a)lists.fedorahosted=
.org</a><br>
Fedora Code of Conduct: <a href=3D"https://docs.fedoraproject.org/en-US/pro=
ject/code-of-conduct/" rel=3D"noreferrer"
target=3D"_blank">https://docs.fe=
doraproject.org/en-US/project/code-of-conduct/</a><br>
List Guidelines: <a href=3D"https://fedoraproject.org/wiki/Mailing_list_gui=
delines" rel=3D"noreferrer"
target=3D"_blank">https://fedoraproject.org/wik=
i/Mailing_list_guidelines</a><br>
List Archives: <a href=3D"https://lists.fedorahosted.org/archives/list/stra=
tis-devel(a)lists.fedorahosted.org" rel=3D"noreferrer"
target=3D"_blank">http=
s://lists.fedorahosted.org/archives/list/stratis-devel@lists.fedorahosted.o=
rg</a><br>
Do not reply to spam, report it: <a href=3D"https://pagure.io/fedora-infras=
tructure/new_issue" rel=3D"noreferrer"
target=3D"_blank">https://pagure.io/=
fedora-infrastructure/new_issue</a><br>
</blockquote></div><br clear=3D"all"><br><span
class=3D"gmail_signature_pre=
fix">-- </span><br><div dir=3D"ltr"
class=3D"gmail_signature"><div dir=3D"l=
tr">John<br>he/him<br>Principal Software Engineer, Stratis
team</div></div>=
</div>
--000000000000b6b959060c57fb18--
------------------------------
Subject: Digest Footer
--
_______________________________________________
stratis-devel mailing list --stratis-devel(a)lists.fedorahosted.org
To unsubscribe send an email tostratis-devel-leave(a)lists.fedorahosted.org
Fedora Code of Conduct:https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines:https://fedoraproject.org/wiki/Mailing_list_guidelines
List
Archives:https://lists.fedorahosted.org/archives/list/stratis-devel@lists...
Do not reply to spam, report it:https://pagure.io/fedora-infrastructure/new_issue
------------------------------
End of stratis-devel Digest, Vol 47, Issue 2
********************************************