How do I change the scrollbar's style?

I’m building a small project with react-codemirror, and I used the vscode-theme:

In their preview, their scrollbars fit the rest of the style nicely:
image

However, in project, my scrollbars seem to be the windows default:
image

Is there some way to make my scrollbars similar to the preview? Would appreciate any feedback!