Low-cost Before Training?