Dungeon Crawler with no levels, Skill points for Attk and Spells

Hello everyone! I appreciate the previous help in my other threads and apologize in advance for posting or asking something that's been asked/posted before.

So in the venture of designing a dungeon crawler, it's very normal or implied that it's done by gathering experiences and leveling up. I don't want to go that route, so I came up with an idea (semi-implemented) where players use a skill system based on a weapon. Basically, the more they use that weapon, the better they become at it (they add more dice to attack roll, they do more damage). Eventually they accumulate skill points which can be used for gaining abilities in that specific weapon (haven't figured this out yet completely, although I recognize that it might be a bit hard to do).

I thought about using a custom dice for each weapon (7 weapons for now) that has sides which will add points to the players Weapon Skill (among other things), although how much would depend on the side of the die and the weapon. Players' skill would keep growing in the type of weapon that they use while gaining Skill points after a certain threshold, and then use those 'Skill Points' acquired to purchase abilities in said Weapon Skill (with limitations and stuff of course).

There will also be spells but I haven't done anything with it yet, nothing definitive yet. Most likely will have an MP system and growing Magic Spell Skill as well, same as the weapons (there's one type of magic spell that each race would excel at, with 9 races to choose from).

Anyway, this is what I've been working on for some time now. I haven't actually playtested anything yet. I probably come up with something in the next few months to try it out and see how it comes together.

Wanted to see what the community thought about this idea. Any advice and questions are always welcome! Thanks for reading!