Demolition crews have moved in on an infamous vacant building on the Pacific Mwy between the Gold Coast and Brisbane.