The objective of this study was to investigate the association between objectively measured patterns of sedentary behavior (SB) and physical activity (PA) and frailty status in Japanese community-dwelling older adults. Data was from 65-75 years older adults from the baseline of Itoshima Frail Study were used. Frailty was assessed using a Japanese version of the FRAIL scale. SB and PA were measured using an accelerometer. Multinomial logistic regression and receiver operating characteristic curve analyses were used to investigate the associations of SB and PA patterns with frailty status. Of the total 819 older adults, half were female (51.8%). The prevalence of robust, pre-frailty and frailty was 60.2%, 27.8%, and 12.0%, respectively. SB variables including total sedentary time, sedentary time in bouts of ≥ 10 min and ≥ 30 min, and mean sedentary bout duration were not associated with frailty status. Except LPA and moderate-to-vigorous physical activity (MVPA) in bouts of < 10 min, PA variables including total MVPA time, MVPA in bouts of ≥ 10 min (bouted MVPA), and steps were significantly associated with lower prevalence of frailty. Area under the curves (AUCs) of total MVPA time, bouted MVPA, and steps were 0.64 (P < 0.001), 0.67 (P < 0.001), and 0.66 (P < 0.001), respectively. The optimal cut-off value of total MVPA time, bouted MVPA, and steps to discriminate between frailty and non-frailty were 43.25 min/day, 9.13 min/day, and 3841 steps/day, respectively. Higher levels of total MVPA time, bouted MVPA, and daily steps were negatively associated with frailty. Lower amounts of bouted MVPA (70 min/week) or steps (4000 steps/day) may be achievable initial targets in older adults for frailty management.