Can a business claim all GST paid on expenses?

No. A business can claim input tax only where every applicable IRAS recovery condition is met — for example, that the goods or services are used for taxable business purposes.