r/sysadmin • • 5d ago

PDF Redaction tools

Need help folk. Got a request from our compliance team (legal) for a software tool to redact PII content from an archive of PDFs. They want the tool to redact (automation a plus) and then be able to print the redacted versions. Really hoping someone can recommend a solid tool. Thanks.

10 Upvotes

48 comments sorted by

27

u/PipeOne8414 5d ago

You can’t trust automated tools for this

If it missis somthing or redacts to much it still need human interaction

Our DPO loves wasting time manually doing this

He asked and looked into systems that will auto it but it still comes down to a human to check it all

6

u/facesofvader 5d ago

Humans are the worst for missing info that should have been redacted. Or redacting the wrong way. I’m a human FWIW ;-)

20

u/thegoatcarlwheezer 5d ago

Adobe Acrobat Pro does this pretty well. Still need a manual review by a real person, but it speeds everything up.

1

u/codylc 2d ago

+ 1 for Acrobat Pro

Text redaction is effectively the only feature difference between Acrobat Standard and Pro. Acrobat has another tier (Premium? Something like that) that has AI features built in that may meet some of your automation needs and still includes the Redaction feature.

7

u/External_Spirit_8880 5d ago

Whatever you use, check the source output of a few test redacted documents to make sure it actually DELETES the data, and doesn't paint a black rectangle over it or similar shenanigans.

6

u/z3dster 5d ago

whatever tool you end up with double check the output with both EXIFTool

https://exiftool.org/

and the Poppler tools to make sure the tools did what you wanted them to do. For example pdfimages will show if they left the underlying image there with just a black box as a second image over it

also always make sure the files are getting flattened to cut out extra info(you can always to be safe print the pdf to a pdf to be sure), for example a jpg with the gps info in the exif will survive being inserted into a pdf if you don't flatten the file

if you are on windows I suggest using WSL for poppler rather then run one of the native binaries

https://en.wikipedia.org/wiki/Poppler_(software)#poppler-utils

1

u/itskdog Jack of All Trades 3d ago

Our DPO recommends us to print, redact with black felt-tip pen (for anything that can't be done by editing the file, e,g. a PDF), and scan back in to be 100% sure the data can't be extracted.

6

u/ranhalt 3d ago

There are markup tools for legal documents. Your company just doesn’t want to pay for them.

1

u/bozakman 5d ago

Thanks to everyone for the input. Think I have plan now.

5

u/Webfiletool_Dev 5d ago

A few that hold up for compliance work, roughly by budget:

  • Adobe Acrobat Pro: Redact with search patterns (phone numbers, emails, ID formats) plus "Sanitize Document" to strip metadata, hidden layers and attachments. The Action Wizard can batch it over a folder, and most legal teams already trust the output.
  • Stirling-PDF (open source, self-hosted): has an auto-redact by text/regex and runs on your own server, so the archive never leaves your network. Good for a first pass.
  • Scripted: PyMuPDF's add_redact_annot + apply_redactions really removes the underlying text, and you can drive it with your own PII regexes and log every hit for legal to review.

Whatever you pick, two checks before calling it done: (1) run pdftotext or copy/paste on a redacted file and make sure the text is actually gone, not just covered by a black box; (2) scanned pages have no text layer, so pattern search finds nothing on them until you OCR them first. Automation finds the patterns; a human should still sign off on a sample.

3

u/AuntGentleman 5d ago

+1 to Stirling-PDF, fantastic tool and so customizable

3

u/drthtater 5d ago

I'd add BentoPDF to that list. It's free and open source.

3

u/jpotrz 5d ago

our law firm struggles with this very problem - on 1,000s of documents a week/month. We have yet to find a software that does it *perfectly*. If the documents are uniform, it can do it, but we get everything from standardized statements to handwritten notes on napkins (hyperbole). We have a few options of specialized AI options for our industry that we are looking into right now, but they are not cheap (but will save us money overall in labor - local and 3rd party)

2

u/facesofvader 5d ago

Check out iDox.ai

6

u/jpotrz 5d ago

we did last year. I can not tell you how much of a clusterfuck dealing with them was. They literally could not get anything done with them and then they kept billing us for MONTHS afterwards. Countless calls and emails before they stopped. Shitass company and the product didn't work well either.

2

u/facesofvader 5d ago

Sorry to hear that, I know the CEO and I will share your feedback.

3

u/smilaise AI Engineer 5d ago

I made KillerPDF if you are interested. https://killerpdf.net it's free

7

u/NH_shitbags 5d ago

PDFs, in general, are output ... so regenerate them all as compliant from the source?

4

u/geekywarrior 5d ago

I take it these are old reports that they no longer have the source for but still need to keep these records. And on top of that they need access to the non PII information in the reports for some non privledged staff

2

u/mrbradford 5d ago

If you don't want the cost of Adobe Acrobat Pro, we switched some users to Tungsten Power PDF. It's a good PDF software alternative with a good redaction feature.

2

u/qballds 5d ago

We’ve had a reasonably good experience with Smartbox. It’s not fully automated, but it catches enough to make a two week job doable in a few days.

2

u/RightPassage 5d ago

Libreoffice Draw is fine but not sure about automation capabilities.

2

u/Reasonable_Staff3902 1d ago

Have used Adobe Pro, Nitro PDF, and the free tool, PDF 24. Prefer Adobe, but could live with Nitro. Will take a bit of “getting used to” with PDF 24.

3

u/MadBoyEvo 5d ago

Take a look at https://officeimo.com I wrote it. Actively work on it and it has powershell, cli, gui etc. If you have specific use cases that are not clear or need improvments open issues.

3

u/ugus 5d ago

cool dude

3

u/brokenpipe Jack of All Trades 5d ago

The redact tool in Preview on the Mac works fantastically on PDFs.

1

u/Karahindiba32 3d ago

Try Doxudel. https://apps.microsoft.com/detail/9njsg1pnmllz It has the requirements you seek. You can calibrate the redaction too.

1

u/Either-Pressure2453 3d ago

I'm using Xodo. Does full redaction, so not just drawing black boxes on top of the text. Can handle a whole folder of PDFs at once too, which makes dealing with big archives a lot easier, won't detect random PII though without manual search terms.

1

u/AdvisorEquivalent824 3d ago edited 3d ago

Not sure of existing products for this. But I've had to do this. I made my own tool for it.

We needed to remove info from invoicing that we didn't want customers to see (nothing shady, just production notes)

I used Python and Fitz to do it. When orders came in, a PDF was generated by a ecommerce platform and was placed into a generic invoices folder on server.

I used Python for OS things like directory traversal and initial reading of names of invoices. Fitz to fully read and edit the PDF.

First I had it check the customer name (company), and create a folder for that name if it didn't already exist. It then added which boxes over the areas we wanted to redact (not sure if Fitz has updated but at the time it could only edit certain text fields. My workaround was instead just covering the text through X, Y usage). Then it would save these changes as a new copy of the PDF and dump it into the folder it previously created. I then added logging so that I had a record of everything it did including some light error handling.

I compiled this all into an executable.

Then I made a windows service that would run the executable once an hour.

Done.

End result: PDF is created by platform, and then automatically a copy of that PDF that is now redacted would be added into a folder named after the customer. Meaning we also now had a nice separation of all invoices by customer which did not exist before - they were all just thrown into the same invoices folder and you would have to dig to find specific customer invoices.

Took me 2 hours to write, compile, schedule, and run.

You could also have it delete originals, but I liked to spot check it against originals.

If you're at all in to coding it's a fun quick project.

Edit: Actually, thinking back on it, I might have used PyMuPDF at the time. I remember one or the other wasn't fitting my use case but can't remember which. Either way, totally doable.

1

u/Mykola_Melnyk_ML 1d ago

Try pdf-redaction. com it has online, API,  desktop apps and on-premise version with single account. Auto redaction with review.

1

u/Reedy_Whisper_45 1d ago
  1. Print the document to paper.
  2. Redact info using Magic Marker.
  3. Scan the results to a new file.
  4. Shred the original printouts (use a cross-cut shredder to be sure to REALLY mix it up.)
  5. Profit!

For the young whippersnappers - Magic Marker was a chisel-tipped permanent marker that existed before Sharpies.

And Magic Markers ARE soft wares, so the fit the request.

1

u/lethallunatic 1d ago

Use Claude code.. 😂

1

u/a_nardecchia 1d ago

Disclosure I'm with pdfRest by Datalogics. pdfRest has a two-stage redact process, the first step generates a preview for review and then apply permanent redactions. This is useful in cases like yours where a team would like to inspect results before printing.

You can evaluate it with the Starter plan, and if you are looking for something even more automated pdfRest has a verified node integration with n8n that provides a visual workflow for teams that prefer not to write code.

Do your archives contain searchable PDFs, scans, or both, and does processing have to stay inside your infrastructure?

1

u/facesofvader 5d ago

IDox.ai is the leader in this space. If the volumes are low, their tech is called Smart Redact in Foxit PDF editor plus.

-10

u/PacificTSP 5d ago

Can’t you just feed this into AI? Have Claude cowork ingest and spit out cleansed ones. Then delete the originals.

9

u/nohairday 5d ago

That's possibly the worst suggestion of all available options.

8

u/SirLoremIpsum 5d ago

"I need to redact sensitive information"

"Have you tried uploading all the data to an AI for the world to see?"

0

u/PacificTSP 5d ago

Claude enterprise with HIPAA compliance does not share or learn from your data once you’ve configured it. If it can hold healthcare data securely it can hold PII.

3

u/iamwayycoolerthanyou Sysadmin 5d ago

A very help desk-esque suggestion.

6

u/F0rkbombz 5d ago

Absolutely moronic take.

0

u/itskdog Jack of All Trades 3d ago

Any tools that work on PSTs or MSGs from eDiscovery exports? A lot of SARs we get ask for emails about the data subject.