It should be possible, because the punishment is fixed-term imprisonment and deprivation of personal freedom. Now he has been released from prison and regained his freedom, and has not been deprived of property rights, political rights and other rights. Therefore, as a citizen of People's Republic of China (PRC) (China), you can get a bank card now.
Whether a credit card can be issued depends on the bank's policy. If there is no criminal record requirement, yes.