We have released a preprint on efficient on-device recommendation [link].