Amino acid catabolizing enzymes emerged as a crucial mechanism used by tumors to dampen immune responses. The L-phenylalanine oxidase IL-4 induced gene 1 (IL4I1) is expressed by tumor-associated myeloid cells of most solid tumors, including melanoma. We previously provided the only evidence that IL4I1 accelerates tumor growth by limiting the CD8⁺ T cell mediated immune response, in a mouse model of melanoma cell transplantation. Here, we explored the role of IL4I1 in Ret mice, a spontaneous model of melanoma. We found that IL4I1 was expressed by CD11b⁺ myeloid cells and that its activity correlated with disease aggressiveness. IL4I1 did not enhance tumor cell proliferation or angiogenesis, but orchestrated the remodeling of the immune compartment within the primary tumor. Indeed, the inactivation of IL4I1 limited the recruitment of polymorphonuclear myeloid-derived suppressor cells and enhanced the infiltration by Th1 and cytotoxic T cells, thus delaying tumor development and metastatic dissemination. Accordingly, human primary melanomas that were poorly infiltrated by IL4I1⁺ cells exhibited a higher density of CD8⁺ T cells. Collectively, our findings strengthen the rationale for therapeutic targeting of IL4I1 as one of the key immune regulators.