The Trump administration is exploring restrictions on billionaire Jack Ma’s Ant Group as well as Tencent Holdings Ltd. over concerns that their digital payment platforms threaten U.S. national security, according to people familiar with the matter, a move that risks infuriating China and disrupting what could be the world’s largest initial public offering.