To further define the nucleic acid determinants of DNA site recognition by mammalian topoisomerase II, base mismatch effects on the enzyme DNA cleavage activity were determined in a 36-bp synthetic oligonucleotide corresponding to SV40 DNA. DNA cleavage sites induced by topoisomerase II without or with the antitumor drugs teniposide, idarubicin, or amsacrine were mapped using sequencing gels. Selected mismatches were studied, and always one of the two strands had the wild-type sequence. The effects of base mismatches were independent from the studied drugs. Mismatches introduced at the -4, -3, -2, or -1 positions, relative to the enzyme cleavage site, often abolished, or much reduced, DNA cleavage, whereas those at +1 and +2 positions often increased DNA breakage or were without influence. Mismatches at more distant positions, e.g., -7, -8, etc., had no effect. Those at positions -5 and -6 sometimes increased cleavage levels. These effects were always observed at sites already cleaved in the wild-type oligomer; new sites of cleavage were not induced by the studied mismatches. These results were obtained both for the native murine topoisomerase II and for the two recombinant human isozymes. No difference between topoisomerases II alpha(p170) and beta(p180) was seen in their response to mismatches. The results demonstrate that topoisomerase II recognition of the DNA site of cleavage requires fully paired nucleotides at the 3' terminus. Nevertheless, similarly to other DNA strand transferase enzymes, both topoisomerase II isoforms may have a sequence-specific nicking activity at the 5' side of unpaired bases.