SIGforum.com    Main Page  Hop To Forum Categories  The Lounge    Are there any linux folk out there? No space left on device error has me stumped.
Go
New
Find
Notify
Tools
Reply
  
Are there any linux folk out there? No space left on device error has me stumped. Login/Join 
W07VH5
Picture of mark123
posted
I've got a FreeNAS file server set up for pics and such to share between the family computers. I also installed pi-hole on a VM in the FreeNAS server.

The ad blocker became a bit flaky and I figured to update it but I keep getting a "no space left on device" error. I found a few discussions online that are dealing with the same issue but the solutions do not help.

I've tried to increase the size of the zvol but as soon as you make it larger it fills itself up plus some according to the FreeNAS dashboard.

Anyone able to take a look or direct me to a better solution?

I'm not opposed to deleting the pi-hole server and reinstalling but that seems like quitting. Smile
 
Posts: 45788 | Location: Pennsyltucky | Registered: December 05, 2001Reply With QuoteReport This Post
Member
posted Hide Post
No Linux folks on this forum. Everyone is W10 Big Grin Sorry, I can't help, just felt like making a snarky remark.
 
Posts: 7822 | Registered: October 31, 2008Reply With QuoteReport This Post
always with a hat or sunscreen
Picture of bald1
posted Hide Post
Hobbs, among others. is a pretty good source here on the forum for linux matters. Sadly he doesn't give an email addy in his profile. Smile



Certifiable member of the gun toting, septuagenarian, bucket list workin', crazed retiree, bald is beautiful club!
USN (RET), COTEP #192
 
Posts: 16640 | Location: Black Hills of South Dakota | Registered: June 20, 2010Reply With QuoteReport This Post
Member
posted Hide Post
Ensigmatic is another good resource. He's managed tons of Linux servers.
 
Posts: 7822 | Registered: October 31, 2008Reply With QuoteReport This Post
Aller Anfang ist schwer
Picture of Tavman
posted Hide Post
I'm available via email in profile. I've been a linux sysadmin for quite a few years.
 
Posts: 1700 | Location: Fayetteville, AR | Registered: May 23, 2005Reply With QuoteReport This Post
Member
posted Hide Post
I believe FreeNAS is zfs so you probably have snapshot issues. I don't use clicky drooly interfaces, I build the systems that do the real work behind those clicky droolies, so I can't tell you where to click to find what you need to click, but..

first you check and clean the samba .recycle folder at your share root, the equivalent to trash can? whatever winderz calls the undelete hole... turn on See Hidden Files in your File Explorer Options to see it, then clean it out.

After that is there should be a Snapshots section somewhere in the management UI of your NAS. This is a feature similar to Apples Time Machine. go there and clean up any snapshot timestamps you want to get rid of..

and while you're there at snapshots there may be some settings you should tweak. ZFS can operate in an immutable mode.. erm... think a quantum physicists wet dream where everything that could happen did happen and every decision creates a fork and an entirely new universe. this, but for data. nothing deletes it just gets hidden, updating a file makes a copy of the file and keeps both updated and non updated data.. etc.. as you can imagine this will eat data.
 
Posts: 236 | Location: Reidville, SC | Registered: October 24, 2009Reply With QuoteReport This Post
Member
posted Hide Post
Here is something I came up with on a Google search... I'm sure others will chime in but you might try this:

Link

My only experience with Linux is using Ubuntu sub-system on W-10 for our software builds. Hopefully this will be relevant.
 
Posts: 7822 | Registered: October 31, 2008Reply With QuoteReport This Post
Optimistic Cynic
Picture of architect
posted Hide Post
FreeNAS is a FreeBSD distribution, not Linux. It uses the Z file system (ZFS) pioneered by Sun. a ZVol is a pre-allocated volume scaled to a specified size (comparable to a file or a disk of the allocated size). A "regular" ZFS volume is not bound by size, or more accurately, bound only by the size of the underlying media (a disk or zpool of disks). There is a ton of information on-line about ZFS. Be aware that anyone you ask for help on this will assume that you have read the relevant documentation beforehand.

One of the processes you are running wants more space than you are giving it. Sometimes this is cache, or data, but more often it is logs. Find out what this is, and stop running it, or change its configuration to be less needy, or write its logs to a volume with more space. I haven't run pi-hole, but this seems unlikely to be the problem.

I also think it unlikely that ZFS snapshots are responsible for filling the volume(s), but it wouldn't hurt to take a look at these too "zfs list -t all" if you have a lot of snaps (name has an @ in it) in the problematic file system, more then thirty or so, might not hurt to remove a few, and take snaps less frequently.

If you don't mind working at the command line, the following FreeBSD commands can help home in on the problem:

% df # shows free disk space, i.e. which volume is getting filled)
# systat -vmstat # shows the general state of the virtual memory sub-system, including disk activity)
# ps auxww # process status, what is using CPU and other resources
% top # like ps, but updated frequently

The first character of the previous four lines is typed by the system as a prompt, the "%" indicates that it can be run as an ordinary user, the "#" means that becoming the superuser (root) is advised to run this.

There are other commands to inspect the file systems, zfs and zpool, these have enough options that reading the man pages is advised before executing them, actually, reading the man page is a good idea before running any command. In a Unix-like system, man pages can be read by running "man COMMAND" e.g. "man man" or "man zfs" You can also find most man pages on-line via a web search. There is also the FreeBSD Handbook that is a very useful resource. The FreeBSD support forums can also be very helpful, but the FreeNAS ones are probably a little better resource for FreeNAS-specific questions these days.
 
Posts: 7031 | Location: NoVA | Registered: July 22, 2009Reply With QuoteReport This Post
W07VH5
Picture of mark123
posted Hide Post
quote:
Originally posted by SirBeep:
I believe FreeNAS is zfs so you probably have snapshot issues. I don't use clicky drooly interfaces, I build the systems that do the real work behind those clicky droolies, so I can't tell you where to click to find what you need to click, but..

first you check and clean the samba .recycle folder at your share root, the equivalent to trash can? whatever winderz calls the undelete hole... turn on See Hidden Files in your File Explorer Options to see it, then clean it out.

After that is there should be a Snapshots section somewhere in the management UI of your NAS. This is a feature similar to Apples Time Machine. go there and clean up any snapshot timestamps you want to get rid of..

and while you're there at snapshots there may be some settings you should tweak. ZFS can operate in an immutable mode.. erm... think a quantum physicists wet dream where everything that could happen did happen and every decision creates a fork and an entirely new universe. this, but for data. nothing deletes it just gets hidden, updating a file makes a copy of the file and keeps both updated and non updated data.. etc.. as you can imagine this will eat data.

Ah, thanks. So many snapshots. I rolled back to an older snapshot and deleted the rest and all is well again. Thanks.

I reapplied all updates and flushed local DNS cache and add blocking came back to life.
 
Posts: 45788 | Location: Pennsyltucky | Registered: December 05, 2001Reply With QuoteReport This Post
W07VH5
Picture of mark123
posted Hide Post
quote:
Originally posted by architect:
FreeNAS is a FreeBSD distribution, not Linux. It uses the Z file system (ZFS) pioneered by Sun. a ZVol is a pre-allocated volume scaled to a specified size (comparable to a file or a disk of the allocated size). A "regular" ZFS volume is not bound by size, or more accurately, bound only by the size of the underlying media (a disk or zpool of disks). There is a ton of information on-line about ZFS. Be aware that anyone you ask for help on this will assume that you have read the relevant documentation beforehand.

One of the processes you are running wants more space than you are giving it. Sometimes this is cache, or data, but more often it is logs. Find out what this is, and stop running it, or change its configuration to be less needy, or write its logs to a volume with more space. I haven't run pi-hole, but this seems unlikely to be the problem.

I also think it unlikely that ZFS snapshots are responsible for filling the volume(s), but it wouldn't hurt to take a look at these too "zfs list -t all" if you have a lot of snaps (name has an @ in it) in the problematic file system, more then thirty or so, might not hurt to remove a few, and take snaps less frequently.

If you don't mind working at the command line, the following FreeBSD commands can help home in on the problem:

% df # shows free disk space, i.e. which volume is getting filled)
# systat -vmstat # shows the general state of the virtual memory sub-system, including disk activity)
# ps auxww # process status, what is using CPU and other resources
% top # like ps, but updated frequently

The first character of the previous four lines is typed by the system as a prompt, the "%" indicates that it can be run as an ordinary user, the "#" means that becoming the superuser (root) is advised to run this.

There are other commands to inspect the file systems, zfs and zpool, these have enough options that reading the man pages is advised before executing them, actually, reading the man page is a good idea before running any command. In a Unix-like system, man pages can be read by running "man COMMAND" e.g. "man man" or "man zfs" You can also find most man pages on-line via a web search. There is also the FreeBSD Handbook that is a very useful resource. The FreeBSD support forums can also be very helpful, but the FreeNAS ones are probably a little better resource for FreeNAS-specific questions these days.


I an a light command line user but I'm not well versed in everything available or what to try when needed but I do ask Professor Google. This one had me stumped. I'll go through those suggestions and see if I can pin down the cause. I may have to wait for it to happen again though as I've rolled back to April and it's running smooth again.

Thank you. You've given more than I found so far. I will dig into the handbook one of these days. I'm back to full time work for now so maybe I'll make some good weekend page turning.
 
Posts: 45788 | Location: Pennsyltucky | Registered: December 05, 2001Reply With QuoteReport This Post
Nullus Anxietas
Picture of ensigmatic
posted Hide Post
quote:
Originally posted by Bytes:
Ensigmatic is another good resource. He's managed tons of Linux servers.

I don't know about "a ton," but there've been a few Smile

Unfortunately, I can't be any help on this one. While I have admin'd a FBSD system, it was a bare-bones system with a CLI only, that was used only to run a proxy firewall, an authoritative nameserver, and a VPN server. And UFS was the native FBSD filesystem at the time, so I've no experience with ZFS, either. Also: Never had a need for a VM, other than WINE, so can't help with that. Lastly: Got no clue about pi-hole.

It's a big world of tech out there, and Mark managed to hit things about which I've little or absolutely zero knowledge

Even then: Were I not already busier than a one-armed paper hanger, right now, I'd look into it. Alas: I got no time atm.



"America is at that awkward stage. It's too late to work within the system,,,, but too early to shoot the bastards." -- Claire Wolfe
"If we let things terrify us, life will not be worth living." -- Seneca the Younger, Roman Stoic philosopher
 
Posts: 26086 | Location: S.E. Michigan | Registered: January 06, 2008Reply With QuoteReport This Post
  Powered by Social Strata  
 

SIGforum.com    Main Page  Hop To Forum Categories  The Lounge    Are there any linux folk out there? No space left on device error has me stumped.

© SIGforum 2024