I think part of that depends on the reason they are a "garage black belt system". For example, I am doing self-defense in my house with my parents and folks from our neighborhood, with a curriculum I developed from techniques I've learned in various arts. Just rearranged into a learning path that makes more sense to me than the one I was taught.
I am of course biased in this assessment. However, I believe I am at least as valid as the arts I learned it from.
This is different than someone who decided they've done a few months of this and watched a few videos of that, and they've read a lot of articles in Black Belt Magazine, so they can probably teach.
Why is it stupid and hard to pull off? Is it:
- The concept is bad
- You were trying to force it in situations where it wouldn't work
- The people you're going against know the concept and are able to defend against it
- You are bad at bursting
I could say the same about the hip escapes. I've tried them in rolling and it's stupid hard to pull off. But then, I've only been training BJJ a month and some change.
There's a lot of different ways you could come across a school that you wish to share your opinion of, and a lot of different ways you could share your opinion.
There's a sliding scale for how welcome your advice is:
- Friend asks for advice about a school he's thinking of joining OR the school comes to you for feedback on their program
- Someone is posting to a community you're a part of (such as Facebook group or Reddit page or MartialTalk forum)
- You happened across a public video (such as on Youtube or a video crossposted on Reddit)
- You sought out the video because you feel it is your duty to shame the inferior
There are then the factors of how you approach it.
- Do you make assumptions about what they do and don't do, or is all of your opinions contained to feedback on what is present? (For example, if it's a technique demo, do you say "they don't spar", which is unfair unless you know they don't spar).
- If giving advice to a friend with the attitude of "here's what you might get, here's what you might miss," or do you just want to point out all the mistakes?
- If providing feedback to a school, is it things that could improve the school, or just "lol you suck".
- Are you inciting a mob to raid the video and nuke it with negative comments, or are you providing your own opinion?
To put it into an example, there's a big difference between these two:
"Hey, I came across this video, and I have a few questions. How do you use this technique in sparring? I've never really seen it used in a live round, and I'd like to know if it can be used."
"Yo, r/martialarts, this video is trash! Everyone go comment on how garbage of an art it is!"
Who determines the level of integrity that an art has?
The simple answer is "The art I train is the best." You can then check the integrity of all of the other arts based on how closely they align to yours. Of course, this could mean anything from "All arts that have this feature are good" to "If you don't do every single thing exactly the way I do it in my school, you suck."
The other simple answer is "What works in UFC?" I will agree that MMA in general is the best simulation of a real fight that we can get. I will also argue that UFC is the highest level version of that simulation. However, there are things that the UFC misses that might apply in a real fight. I'm not just talking about the cliché (but in my opinion, correct) items of multiple opponents, weapons, and banned techniques. I'm also referring to the level of resolve and training in your assailant, the goals of both the attacker and defender, and other things like that, which self-defense arts tend to cover better than UFC.
Then there's the general concept of pressure testing itself. Experimenting with individual techniques can often be problematic. I'll give a few examples:
- Ramsay Dewey mythbusting a handgrab escape. He uses the same exact motion against the opposite grip. His conclusion: the technique doesn't work.
- Hard 2 Hurt and a few others trying to see how easy it is to kick someone in the groin. The ONLY techniques being used were groin shots. It's a lot easier to protect your groin when that's all you're defending, than when you're also defending against leg hits, body hits, head hits, and any grappling.
- A BJJ video dispelling the myth that you could bite someone's arm if they try and choke you, which was only tested if the choke was already set and locked. They didn't test while locking the choke or any other situation. Only when the head is completely immobilized already.
Then there's the question of
if you could reliably create such a tier list of arts with and without integrity, are you judging them solely based on their ability to produce proficient fighters, or are you going to give them the "integrity" ranking if they openly admit their tier status?
For example, let's say an art is a C-Tier art. It's got some nice ideas, but doesn't really apply them well. But they openly admit "We're a C-Tier art." Are they with integrity? The funny thing is, by this standard, every art would lack integrity, because all schools think they teach the best art. The worst offender of this is probably BJJ (specifically looking at the Gracies), and how BJJ is a good art, but they make it sound like everything else is trash.
Then let's take it a step further. Would you condemn every school that teaches an art, or would you give allowances for schools that meet your standards? Why would they care what you say instead of what their parent organization or their lineage says?
I prefer to look at what you can get from an art, and how it can make me better, than try to act better than them.