If the item ever was in stock and you only want to see that it is now at zero, then use the Inventory Part in Stock overview for items at 0 Quantity on Hand.

I suspect this isn’t enough for what you want, but that depends on if you want to report on every item that was inventory at one time.  Else, you need some other information or parameters to construct a report to tell you this answer.