Token-Based Dual-view Fusion and Adaptation of Large Vision Models for Breast Cancer Classification