Life happens! Your SaverLife account just needs to reflect that you saved $5 or more each week. The total of all deposits must be greater than the total of all your withdrawals within the "Savings Period."
As long as you put back what you withdraw in addition to the $5 weekly minimum, you can still earn a scratch card. That means if you withdraw $5, you can still play as long as you save $10 before the deadline.