To unpublish an FAQ section, you must unpublish all of the individual FAQs in that section. If any FAQ is still published in that section, then the section will remain visible.
To unpublish FAQs, navigate to the FAQ in the Dashboard and click on the ‘Published’ toggle to move it to OFF.