Uploaded image for project: 'MariaDB Foundation Development'
  1. MariaDB Foundation Development
  2. MDBF-890 Generic activities Sprint 1
  3. MDBF-894

Fix MacOS Storage Full

Details

    • Technical task
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • N/A
    • N/A
    • Buildbot
    • None
    • Sprint 1 (13.01.2025)

    Description

      Alerting for macos-bbw2 worker is constantly reporting > 90 % disk usage on FS /System/Volumes/Data/
      After some research I've found that a possible culprit is Spotlight.

      SpotLight is building an INDEX for every file written on the FS, under normal operation it should reclaim space when the file is deleted. Spotlight indexing is usually used for Finder or other utilities that need to "find" very fast a file on the drive.

      It seems that the nature of Buildbot of writing tons of small files under longer periods is not letting Spotlight clear it's index properly.

      Attachments

        Issue Links

          relates to

          Task - A task that needs to be done. MDBF-922 Disable MacOS spotlight indexer in ansible

          • Major - Major loss of function.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            rvarzaru Varzaru Razvan-Liviu added a comment - - edited

            For the moment it looks like:

            sudo mdutil -X /System/Volumes/Data


            -X volume-path Remove the Spotlight index directory on the specified volume.  Does not disable indexing.
            		 
                                   Spotlight will reevaluate volume when it is unmounted and remounted, the
            		 
                                   machine is rebooted, or an explicit index command such as 'mdutil -i' or 'mdutil -E' is
            		 
                                   run for the volume.

            is doing the right job.
            after just ~1h, a lot of space was reclaimed.

            /dev/disk5s1     500Gi   307Gi   140Gi    69%     34M  1.5G    2%   /System/Volumes/Data

            I paused bbw2-mac worker until the command finish.

            rvarzaru Varzaru Razvan-Liviu added a comment - - edited For the moment it looks like: sudo mdutil -X /System/Volumes/Data -X volume-path Remove the Spotlight index directory on the specified volume. Does not disable indexing. Spotlight will reevaluate volume when it is unmounted and remounted, the machine is rebooted, or an explicit index command such as 'mdutil -i' or 'mdutil -E' is run for the volume. is doing the right job. after just ~1h, a lot of space was reclaimed. /dev/disk5s1 500Gi 307Gi 140Gi 69 % 34M 1 .5G 2 % /System/Volumes/Data I paused bbw2-mac worker until the command finish.
            rvarzaru Varzaru Razvan-Liviu added a comment -

            Fixed.

            Filesystem        Size    Used   Avail Capacity iused ifree %iused  Mounted on
            		 
            /dev/disk5s1     500Gi    70Gi   378Gi    16%    574k  4.0G    0%   /System/Volumes/Data

            Unpaused the mac-bbw2 worker.
            Disabled index on both mac01/02.

            sudo mdutil -i off /System/Volumes/Data

            rvarzaru Varzaru Razvan-Liviu added a comment - Fixed. Filesystem Size Used Avail Capacity iused ifree %iused Mounted on /dev/disk5s1 500Gi 70Gi 378Gi 16 % 574k 4 .0G 0 % /System/Volumes/Data Unpaused the mac-bbw2 worker. Disabled index on both mac01/02. sudo mdutil -i off /System/Volumes/Data

            People

              rvarzaru Varzaru Razvan-Liviu
              rvarzaru Varzaru Razvan-Liviu
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0d
                  0d
                  Logged:
                  Time Spent - 3h
                  3h