Avoiding fakes news: Why and How

Why you should care about fake news?

Truth is you should not. You should care about interesting articles and contempt the literacy level of journalists. Yes this is shameless journalism bashing


Anyway this is not about "how and why" avoiding fake news it is much more about the questions how and why are not equivalents and that they lead to a real problem.

First I challenge you to read press article every day. You will see especially among the ridiculously pedantic french self designated fact checkers les decodeurs from the reference newspaper lemonde that most of the articles on fact checking are titled with why...? and this is the majority.

Now let's look at how often people ask why vs how in google trends (experience reproduced with same result in french).


Basically people want to know HOW and news like to tell us WHY.

I am gonna develop a saying from one of my physic teacher that I respect for saying:

Why is a question of religion calling for an opinion, How is a question of science calling for an explanation of the mechanisms.


Asking why man evolves from primates? is not the same as How man evolves from primates? .

If your answer the HOW question you will leave to the persons an examination of the mechanisms, letting readers build their own personal opinions. And honestly I find it normal for persons to actually doubt, refute and criticize the evolution. A good theory does not get discredited by opinions but by facts, and I would accept as progress if someone would come to give a better alternate equally simple explanation of the origin of humanity on earth. His/Her motive I could not  care less. To be simple religions do not provides simpler predictive and check-able mechanisms.

Good debates comes from discussing on what matters : the facts and mechanics, not your motives.


The funny part of evolution is funnily that it get rids of any design or motive to explain evolution, it is a non opinionated mechanism regarding purposes based on randomness. The evolution says that there is no need for an intention to obtain human on earth. It just kicks God of the creation of Human, which basically

The strength of Darwin was to answer the question how can we explain the variation of the species and ignored the question why.

It actually is not an atheist theory, it is God agnostic. It does not deny the existence of God, it just states whether God exists or not he is not involved in the process.

And well religions contempt randomness as much as journalists. They want to be the smart guys unveiling you the hidden motives behind news. News and media are all opinionated. I do not mind. No readers mind. We all like opinionated people with whom we can build a nice utopia.

But I think and notice that all readers even if leaning in the same direction as a media wants to make their opinions by themselves. They ask google how. We are better all left checking facts by ourselves.

How should therefore be present in more wording of news and article than why.

Does it means WHY does not matter?

Today I saw an article that the cours constitutionnelle invalidated the decision of  the parliament on making Google pay tax as any other companies on the territory.

It took me 4 pages of google specialized search to have access the document on the motivation of the decision. Because, the motivation of this institution have to be based on the constitution. And I wanted how it was possible. For this I needed the answer to the question why.

Bonus here is the answer : Google has been cleared of paying tax because else it would break the rules of egality in front of the law. Google does tax dodging (illegal evasion) but they must be authorized do tax dodging since it is the norm. Every one does it, so they cannot forbidden to do it.


That is much more the information I was looking for. Basically this country is the farm of the animals where physical citizens cannot do what moral entities can. Some animals are more equal than others but that does not bother the experts of the constitution.

So, are there really any fake news at all in the beginning?

I have done an unnice claim about journalists. Sure I hate the way they write in any language, but this purely an opinion without any grounds. My trollesque opinion is that they are educated yet idiot that do not understand the difference between how and why.

However, I should be ashamed. This does not matter at all.

Here we have a problem that does not require hidden motives of journalists, or complex mechanisms to analyse the problem. Why is not a good question here.

What we can guess from google trends by opposition to a frequential analysis of the title is that there is a gap between what people ask and what media answer.

And I think that it is as simple as that : news are seen as fake because the offer is not in conjunction with the demand.

Journalists question motivations too much in regard of mechanisms when something happens and are not curious enough of the motives of actors when they take a decision. Maybe, medias ignore the raise in literacy of their readers and may need to speak to their readers as smart people.




Being angry as a wolf makes you sacked and happy

Pun intended. (cf Duran Duran)

Have you been so sick, you just think you are gonna die?

Have you been checking dozens of physicians that tells you, you have nothing and it is all in your head?

It has been my routine every winters for the last 30 years.

It used to not matter: I always conveniently chose a room faraway in any place so that my cough would bother no one.

But now I have to face my angry spouse that really would like me to stay alive and raise our kid, and we have been living in tight spaces since we met...

Funny how small problems of 3D geometry can matter.

So basically: I cannot sleep at night, unless I accept to drown in a weird foam coming from my inside, wait 5 hours of zen acceptance of being between sleep and fucking vital reflexes waking me up because I literally drown in my own water and asthma get triggered while my body also try to put me to sleep to recover. Dreaming of drowning and yet being physically drowning in your own perspiration? Yummy!

Funny fact: unless you ask me now (the morning after), I have no memory of it. Just like pregnant women cannot remember what was their pain during the labour.

And during these nights I live the dreadful perspective of dying.

This morning I have a cheerful song into my brain when it comes to the melody (a New Orleans kind of tune) from everlast: when I was a very young boy, [my cough] told me we're all gonna die. (in the original lyrics it is mama not my cough)

For years, Doctors, shamans, and all kind of nicely knowing persons have gave me their bests at trying to heal me: but I suffer from nothing.

And at the end, I am either denied to suffer, or told it is God's way to tell me I am a bad person...

If I talk about it: I am a weirdo. If I say all kind of medicines are failing I am a liar. Because everybody knows that they are right in their beliefs.

So in order to have a social life I must forget the feeling of drowning in my sleep. Of feeling I am gonna die. And every morning, whatever my body is telling me how much my lungs, my heart, my sanity are damaged, I reconstruct a socially acceptable normal self: one that does not suffer, and like everybody else don't remember he well die. And go back to work or pass exams.

But there is a side effect of suffering huge amount of pain. You have a short amount of morning clarity the morning after...

One that tells you something important: today I AM ALIVE AND KICKING (and feeling like a fucking vulnerable weak shit (cough, ouch, cough)).

For some days (usually no more than 3) your priorities are re-based on one thing: you have one and only one life.

Only one that matters, and all the social limits put on your brain kind of falter.

It is like a smoke of screen that basically is our social based educations gets partially torn, and you are having a wake up call. 

But, why do conflicts always appeared these morning after at my jobs I always wonder? Why my accepted obedience to society gets in the way of my will to live as I wish?


Actually, what do I wish?

For one thing, knowing that I am gonna die, I used to drown myself in technical stuff that requires so much focus that it diverts me from thinking of it too much. But also, excelling at doing give me a sense of internal peace and fulfilling.Totally crazy batshit crazy thinking. But I discovered it worked.

I love to do stuffs, because they help me squash away my fears, and I am all the more relieved that they are done the more correctly I can. The pleasure of some well done work. I am all the more attached to try do my code correctly that I know I am a temporary being on this earth.

And writing good piece of intellectual work is hard. So hard, I don't like most of my code, but I stubbornly try to make it better, or at least as good as I know it can be done. And I make mistakes ... a lot of them. From which I learn.


Because of this, my getting fired day often happens after these kind of existential wake up: I love to do stuff correctly because that helps me feel alive. And I like facts.

On reddit and hackernews I often get downvoted for being savage as fuck. But, the true story is truth is always savage.

Authority and status do not like being questioned. And there is no way in political context, Truth can be told.

More than once, even though my skill in security expertise is low did I spot obvious security holes. My expertise comes from the fact these mistakes are often mistakes I made myself and recognize.

Let's begin the story telling

A level III engineer (I was a probatory level I) really hated that in a code review I spotted an SQL injection : he was using an ORM, it was therefore impossible there was an injection ... unless he was building the query as a string and then sending it raw for execution.... argument he always discarded as false (fallacious behaviour) and as a threat to his authority. I told him that we all did mistakes, but apparently, since he as always be coding this way it could not be possible (else the solution would be flawed to the core).

So he left me to be dealt with higher level of managements that asked me to do a mission on a critical payment & authentication system, but without the documentations.

So, I had to reverse engineer the tool from 3 functions calls and a proxy web server.

It was JWT based solution. And, I spotted the very expensive auth system was failing 40% of the time. I thought that I must be stupid or the emperor was naked. Long story short feedback from the production were telling me the emperor was naked. Everybody knew but nobody would tell it because they used the wraith of the managerial authority with convocation to the higher managers to shut you down and give you a blame.  Security obfuscation by retaliation.

Technical detail, I found by frequential analysis I was dealing with a base64 string, I decoded it, I found keywords, googles them and found a RFC. Then, I read it.

Basically the «secured» solution that was given as a token other HTTP GET method was a base 64 encoded string whereas the RFC mentioned it should be a urlsafe base 64 encoding... It made sense. But the devs, instead of a using an external dependency to have more control, rolled their own crypto.

In a company that is so big with so much turnover with so proud of hiring so much ninja coders  thousands of experts have been hitting this bug for YEARS.

So, how does a life and death concerns in the morning affects a stupid technical problem? When you have a wife and life matters more than a stupid problem of a dysfunctional hierarchy that has ego problem, thinking of the relativity of coding compared to have an happy life should matter the most, no?

All my friends always told me to use my smart brain to do what everybody does: shut my mouth.

Me, after a bout of cough, my brain becomes stupid: I filled in a security bug and a functional bug report describing with a sample of code on how to reproduce the problem, the mathematical calculus to compute the frequency of failure, I used side channels to have figures to compare with the observed production rates of failure that were matching  the analysis of the reason, why it happened and how to fix-it.

48 hours later I was shamefully brought to my desk by a security agent in front of all the coworkers to fill all my belongings in a box.

Years later, this bug is certainly still in production and affects million of users and have huge costs for the company. But, when I am telling the name of the company every one tells me, they should be proud of their products and I was dead wrong.

So, my conclusion on this episode is : security by pressure aka the naked emperor syndroma is real.

I will succinctly multiply the examples but let me tell you, it happened to me a lot. I more than once had a security engineer on vacation and needing secured acces to works.

Once I used an exploit in a linux perf counter to get root access ... that I reported when he came back. Needless to say I was not thanked for reporting ALL the linux servers were vulnerable for 6 months.  (Same perfect company some of my respected security experts friend give their credential to).

Another time, I had to play with a jar (as if I ever coded in java) to read a library and guess that a «secured payment system» from Orange telecom was in fact based on the repetition of an XOR on a fixed string, with white space padding, with fixed data... Well, I «cracked» the password because else the company would not have been able to process the payment. I had to fill in my box one week later. The buy in one click feature from ISP is the one I oddly never use.

Another time I just told to a CTO you cannot make an exact 100 top ranking by merging 10 top ranking on 10 shards. (Distribution matters). I was told, math lie.

And that well, there was also quite a few SQL injections somewhere else ... for which I was told the ORM magically protect mantra ....


My hazed brain does it every time I wake up having the feeling I nearly died from my coughing in the night. I forget about social context. I am just bluntly honest about my work. Because that is my life saver.


Every time, when I get back to work my brain switches off the social limiters and when something needs to be done or said because it seems the obvious stuff to do to go on and jump to a new thrilling adventure my brain tells me: Oh! everybody is like you! We all know we are weak, make mistakes and how can reporting a factual technical simple problem having a fix that is ready backfires?

Every time, I decide to take the bull by the horns and say, look we have a problem that can be fixed.

Truth is problem is often already fixed by layers of duct taping programming that hold the solution afloat and a lot of jobs relies on this duct taping. We sell dreams not facts. We want stuff to look as if they are working, we don't actually need them to be correct (except if it is in a nuclear plant or for a peace-maker, or for an autopilot?)


But being alive is not being a coward that does what has to be done to protect your social position.

Being alive is liking who you are. And if you define yourself by your love in what you do, then if being true to your own self is trying to make things work, then it is what has to be tried. You have only one fucking life!

And believe me: there is no way human beings do not take it personally when they made a mistake and you spot it, it is just that when it is made by the upper management they will fire you. If it is an intern, he will just resent you in your back except if they are some of my precious padawans I am proud of having enlightened.

And now, I don't even remember that I had the feeling I died tonight. Focusing on these petty technical problems makes me forget all about this. The feeling of my own pain and agony is gone, and even though I put my social status at risk, I feel at peace with my own self doing the stuff in the way I think maybe correct.

My brutal honesty get me fired, it get me blocked at human resources interviews, and right now I live with the social minimum in a dire economical situation. But, fuck, honesty and living as yourself 24 hours a day is wonderful.

People see me as savage as an angry honey badger. I prefer to say I will not bow. My pride as a human is as vast as the eternity of void that you can expect after your own death. 

Life is to short to live life as a full scale role playing game. Be yourself, and love who you are, and what you do, even if it hurts a tad. It will never hurt as much as wondering on your death bed why you messed up your only chance to live according to your own self.

And after smoking, my body fluids finally leave my lungs, giving me my much appreciated certainty tonight the problem will be fixed... and I dare not tell anyone that my cough was worse when I stopped smoking. Because ... everybody knows like Adolf H knew and all the others hygienists that there is no way tobacco can help... Yes it does, as much as smoking weeds, but I cannot: it is illegal.

Fuck my life on this, and please if nothing can heal me and legal medicine has given up on me, let me have access to the devil's lettuce that at least can ease my pain. Let me suffer less. Pain is not FUN!

The coders' ethics is plain bullshit

Oh! Coders are taking a virtuous stake in being ethical:
  • major US IT actors such as google, FB, twitter will not code a database of muslims and encourage developers to sign a chart about it;
  • a ban on killer bots (drones excluded) is proposed;
  • the IT industry (that reduces your choices while searching the web) are agreeing to show you «better choices»...

Well, it is a smoke screen, most of our activities are non ethical in terms of everything we pretend to be...

What IT means ? Information technology.

How do we define Information? As the number of relevant choices proposed to any requests over the whole possible choices.

Our job is very often to limit often by idiocy sometimes by following orders without critical thinking your access to information.

I have already treated poorly the bubble of reality that search algorithm makes. And I think the topic is boring.  So, I will prefer real life examples of stuff I did as either a freelance or a job.


Pure illegal activities

 

I have been a contractor, and for years I have been working for the media industry. I have taken part in violating the law to keep my job under peer pressure to keep the activity running.

IP theft/plagiarism is probably the most common activity I have taken part in my career as a coder, because I am free software specialist.

I mostly have taken part honestly in stealing myself, though.

Let's take this wonderful multihead solution based on linux that I helped building when I was young. You may have seen it working. It was based on linux, but the hardware description said it was based on a GPU that was never supported by linux. How can?

Well I coded the driver. My boss was a FSF free-douche, the kind that would bend the truth to oversell free software and its «intrinsic virtue» for the democracy, security & al. He said, we don't release the code:
  • license just means that it should be available to those who ask (and we never hinted customers about their rights);
  • the (cooperative) company owns the code anyway, so it is not you to decide how to use it. 
In my career as an open source developers this story has happened at least 3 times, and it has happened a lot with free software enthusiastic believing in the FSF: the most hardcore Open Source tenant with a strong moral stance. I dare say I do since have a very strong defiance towards people with a stance. Now I prefer to judge people by their actions.

I have also one time be mandated to code a spamming solution.. oops an efficient marketing tool or set them up.

Actually it was pretty okay in the opt-out part.

But every time I was forced to let customers input their email by batches from fishy origins without control. When I said, maybe we could give check if these lists are legitimates or to let people report that it was no optin, I was cock blocked.

I have even been asked to try to protect a spammer and asked to fight spamhaus while working for an ISP

I have taken part in fighting laws I totally support. Sometimes.

I have been talking a lot to my colleagues, and friends about this crossing the red line ; mainly the answer was : we all do this, because it has to be done and else we will have no jobs.


Grey activities most of the time : tricking people

I have also been taking part in activities that are about not committing crimes directly, but much more taking advantage of people by hiding information about important contractual part.

How much a free farting application costs on a mobile phone? Well, according to most it is free. But what if in small printing it is written that if you don't explicitly resiliate the free subscription it will be a tacit infinite reconduction of a .70€/month bill that no one notices? Your farting application can cost you 19€.

How can you be proud of manipulating the OS of a smartphone to make people send overtaxed SMS sneakily and then erase them from the list of the SMS?

While working for the advertisement industry I have been on numerous occasion working on deceptive (but with small prints still) websites for games and cooking recipies which were total clickbaits in order to collect personal information. It is not illegal if the information is there? But where?

I have tracked you with zombie/everlasting cookies. Pop-under, pop-over have no secrets for me, I have been altering the content of information web sites to the point I was potentially able to alter the news websites' information. The googleAds and co are fucking security holes. I could have put a financially fake news in order to manipulate the market if I were truly evil. But, as numerous coders I never talk about publicly (like on a blog) it because :
  1. I would have been blacklisted;
  2. the industry losing trust would mean the job disappearing. 
I have been taking part in activities I reprehend in order to keep my job alive.


I have been überized before it was cool


How do you call a worker with multiple customers but in fact has one and only one intermediary actor in the middle?

Well, an überized worker.

Like a driver, a coursier, a pseudo construction worker ...

How do you call this when your job is to be hired to do the job in a company that have the ability to do so for less?

You call this a yellow stupid überized.


Well, like every one else being jobless I was proposed it as the only way to have a job; I however know that in doing so I broke numerous work and contract laws. Well, choosing between living in misery or in integrity is quite a choice I did not have.

Big brother activities


You know the gun makers excuse ? It is not me who makes dangerous tools, it is those who pulls the trigger who are the dangers.

One of my specialty is log extraction and analytic. I have been building numerous tools that given in the wrong hand would result in mass surveillance. But for my defense, this is a routine activity we do. Oddly we always log the users even intermediates, even eventually the one doing the queries, but never report to the lower levels the fact they have been targeted by the query. Ooops, cost to much and not a desired feature.

I have taken part in supervising activities of workers that violates international conventions on legal length of workdays, what is an acceptable in terms of lunch/rest/toilets pause ....

Well, you know, I have not been alone, we were all involved in the technical, marketing and financial department of the company. My work has been by a lot of standards a slow slippery of concerns.

I am a good sheep. In fact, I have been considered a pain the ass for calling some a tool big brother and for asking my CTO that is a pro privacy/cryptography/freedom if he had no problem with his inconsistent moral stance in public in regard to what he was actually doing?

I guessed that may explain why he threatened to beat me one day and threw me an object at my face in the open space and then went on firing me immediately.


Breaking the working contract


You know in the big brother activities are funny. I can totally measure your work activities when you login, logout, call your mail client.... and you know for what I have sampled mentally of these logs, people are always working more than advocated.

On the other hand, application coded by fellow coders tends to forbid to input more hours than actually made. All the «timesheet» applications aka digital punch clock I have used required a manager authorization to enter the extra work hours.

It is funny how we can measure stuff accurately when we want.

50 - 70hours per week paid 35 in my industry are totally legitimate, and there is no evidence of the opposite, because, well, lol, our tools may be a tad biased.


Have you tried to be ethical?


Ethical? I don't understand this word, but let's say I do since I came back from Canada.

Results : I parse 900 work announces per week, answer to at most 3  go to numerous interviews and do not hide my intent of living by the laws and contracts.

So far, the only job for which I have been accepted had been mover (driver/riper) and it was a great personal experience.

Well, it is good news. I don't have to live in fear or give up : I can still find a job.

Most of my friends says my attitude towards IT is suicidal, I do think the opposite : IT industry is suicidal, and I am no lemming.

E-commerce is based on trust: lose the trust of your customers and you lose your business. And maybe so far you have not lost a lot of customers yet butme. I know enough of the landscape of IT to distrust most of the so called disruption coming. The IT market nowadays is basically a gigantic scam based on promising a gold rush on some technologies that you sell. The ones who made money from the gold rush were not the miners, but the shovel sellers. This what It are: scammers selling you shovel to scam other people. 

And to conclude, my experience at trying to raise ethical issues in my numerous pro life in IT is that it results in you being fired.

The actual fuss about let's be ethical is just a clever marketing trick as long as workers are not recognized the right to oppose more than questionable/illegal activities. And, we are not. The only ethic we are authorized is the one of those who pay. 

And I may be special, I decided to live by my own standards and I don't fear to be sacked, threatened, physically beaten, living in misery once again.

And, that is my choice, not an ethical one: a selfish one, I love to look at myself in the mirror and be a tad proud of who I am unlike the vast majority of my colleagues who have been involved in all these stories. 

Do whatever you want, but everything made by peer pressure and publicity is not ethic, it is just marketing or just buying the indulgence of the crowd for the shit you made as a catholic buying his indulgence to the Catholic church in the middle age.

Ethical coders, I do not belong to this movement and I despise it.The vast majority of my profession love moral stances and doing the opposite of what they advocate when you can't see.

Frameworks are tools for monkeys not needed by fishes

TL; DR


Frameworks are scuba gears made for monkeys that love to climb the height of complication.
Some other kind of developers are like fishes that feel naturally at ease with swimming in the water of the problem at hand, without requiring frameworks.
Coders who can and prefer to swim and are infuriated at the absurdity of being a fish trapped in a scuba gear.
Prelude: I kind of refer to this quote mis-attributed to Einstein.

Once upon a time

 

People did write their code by reinventing the wheel and it was crap.

So people decides to mutualize their code and it was good.

When it was small pieces of code it was called library, when it was bigger it was called frameworks.

To be an honest liar nothing distinguishes a library from a framework except the name given to it.

Stuff like openSSL were called library by the idiots, but a crypto framework by others (that may have written libressl). OpenSSH use to rely on it for everything except opening ssl tunnel which was the use the monkeys were seeing it could do.

Industry/fashion soon decided that the difference between framework and libraries were the size and the «genericity of the bousin». Bousin is a norman word that is totally legit in en_UK.


Of monkeys and fishes


I strictly don't understand why but when the wise points the moon, the monkey look at the concept of the moon when the wise just point at the moon.

You see frameworks don't exist. And when people see them, they think they are complicated stuff. Don't blame them, they have been studying and passing exams.

Most educated yet idiots think a complex idea must be complicated.

So they want to prove better than others and climb the mountain of the problem as a monkey and be the king of the hill. Showing off basically.

If coders where musicians it would be the difference between the stupid one playing simple pentatonic because it is easy to learn and master and the other one making a religion of it.

What makes music sound great is not your virtuosity (playing like Steve Vai, Ingwie Malmsteem, Satriano) it is your musicality (BB king).

It is not how much complex concepts and how much notes per seconds you can play, it is music.

Virtuous coders/musicians are like monkey, they love heights. They don't understand music, but like nerds they want to prove they can handle complicated things.

Complex is a lot of simple things put up together making a stuff. Complicated is the same thing but with the idea some powder of it works by magic making the result immutable. Complication vs complexity is in the eye of the one watching.

A monkey will see the framework as a tree that makes you reach new height. The monkey will tell you : you don't have to understand just put yourself on the giant's shoulders. The fish is different : he swims in the turbid waters.

So monkeys love frameworks as ladders bringing him to new heights that have never been reached before, thinking you can grow trees on trees to make a way to reach higher height, thus the moon.

But sometimes, your problem are not higher. They are just about getting to the food for less effort in turbid water. Getting the job done.

Making a SPA (Single Page Application) is not about using react, angular, or WTF. It is about making a web page able to load states that are stored in a database (be it a filesystem, a RDBMS, a noSQL shit, or memory) and then make the HTML page reflect this state and give you way to change the state of the application inside a Finiste State Machine through calls.

The fish just remember that a ssh connection might do the job better, but his project manager want it to be a nice HTML web page, so he does whatever he is asked, because the one who pays is always right.

The monkey have read there is a framework for doing it, so he does not care. He tries to put all his use case inside the constraint of the holy framework. He knows the manager reads some papers so he does not question authority.

There is a difference between accepting your managers are stupid and embracing the stupidity of your management in order to keep your job.

The monkey climb the Everest of the stupidity to please management. The fish just try to do the job and eventually use frameworks.

But for a fish frameworks are no trees, they are just scuba gears: they let monkeys evolve in the turbid waters of programming. We all are blind in these waters.

Every frameworks are like an additional part of a scuba gear that makes you less agile as a fish, more encumbered with rigidity.

Does rigidity makes you agile when you already know the ways?

Not really. But you are judged by monkeys fearing water and wanting to be dry as a loveless cunt while diving. 

Computers are ugly, they are limited by ... science. e = mc² is everywhere.

Even the number of cycles required to access information is limited by the speed of light.

Monkey coders think that the limit of science will/are being broken by giants on which shoulders they stand. They name their giants with name like CAP, ACID, distributed/graphs database machine learning and they think that once they know the name of a problem the problem have been solved by pushing more frameworks to the problem.

The fish is stupid.

He just sees framework as constraints, scuba gears and think there must be way, but that putting a fish in scuba gear will not make him solve the problem and that monkeys are really not the most able animals for the job.


Can there be ethic coding nowadays?

I am a coder. I live in a state that recently took the direction of USA in terms of doing what Snowdens revealed: mass surveillance and automated opinion tagging on the public space.

The question is can we code and look ourselves in a mirror every morning without disgust?


I have taken part in ethical coding of big brothers tools for call-centers.

Do I feel proud? I should not care according to my peers.

Well, I have been searching for jobs recently and what I am proposed is very often revolving about the same topics:
  • surveillance of work hours and profitability of the employee with poor or no respect of legal obligations of employers;
  • profiling for marketing (can also be used for mass surveillance);
  • automated troll caving of any aggressive persons on a forum (because disagreeing is a sign of being bad, m'okay?);
  • Xross Site Tagging of internet users;
  • frameworks development for doing all of the above.

(I do insist there are some  good job offers in the flow of crap)

Of course, since I am supposed to be a bitter old coding troll I miraculously have been an ethical coder. I could say I chose to be a virtuous ethical coder.

I am not. I want to have hot water, heating and some place I call my own. I need to feed my family and rent a place that in a 30 km center around this place require an healthy 60k€/year. So being a mover will not make it.

Is it ethical to let my family in misery because I have principles? Well, at least it looks cool. That's how to be a flamboyant looser. I actually did not chose. I am just socially inept. That is who I am and I am okay with it.

But since I am a blatant troll I prefer for the fun to victimize and point a finger by asking a question:

Are unethical coding topic the only one that brings value to the share holders?


Well, could banks, VC, government make of coding a good use?


Green energy?

A vast joke: max electric power on the grid is required when no wind nor sun provides energy and we do not know how to store efficiently with a reasonable safety and costs. And battery production is resource bound. Green energies are just a mirage. Power demand is constantly going up (notably thanks to e-commerce and computers), while power production grows less. We may face in the coming decades power blackout in the G20 countries. But X said the opposite and he has figures.... Let me doubt it.


Automated tax collection to avoid fiscal inequity?

Garbage In, Garbage Out : fucked laws make fucked up rules that are un-codable.


Privacy to avoid surveillance?

On this one I am a convinced lutherian; if you do not need to commit a crime you need no privacy and if you fear your government, well going down in the street might prove more useful than writing code. Even for talking. Internet is not the place to foment a revolution. It is a nice place for mocking the world, though.


Multi purpose robots?

The industrial revolution based on automation have always resulted in removing from the market the economical actors that were not granted the money from their bank to buy automats resulting in a winner take all scheme while the poorest sunk in misery and the middle sized actors enter a spiral of taking series of immoral loans from the bank. Like a modern peasant in France. Capitalism centric economy are anti-liberal and results in more concentration.

Profiling?

Profiling always has the best intentions at heart and poor production. Even the best coders forget the law of using filters: filter have false positive and false negative. There will always be people that are wrongfully tagged «positive» and you will always miss some of your target. Efficient filters are based on the acceptable costs of failure. Marketing can fail, it is okay. Counter-terrorism based on profiling is a very stupid idea. And maybe it is better to remove the roots of dissatisfaction from a society (discrimination, inequity, poverty) than to spend money on detecting the person that are dissatisfied. Especially that Europe is not very far from electing people like Trump, Putin or Erdogan in the next years. You want to explain to someone like Erdogan that he might wrongfully ruin the life of thousands of people while he has a solid list of 10 times bigger accurate opponents being known? Please show me how Erdogan, Putin care about the costs of false positive with a profiling that catches 90% opponents accurately. Remember in Europa a growing number of future president/PM will tend to be Trump/Putin/Erdogan like. Just think about it. Yes, we can also prevent Vascular Accident alike. Or improve medical diagnostic, that requires ... a lot of centralized information. This is a double edged sword and I don't think our society is mature enough for radical transparency. We all wanked, and who is okay for having it officially known? The problem is the christian culture of guilt here. I am a convinced guiltless atheist on this one.


3D printing?

Hum, much more interesting. In fact no. KPEX is not the only problem, you have also the OPEX and quality control to see there. We are back to the multi-purpose robots. It covers also topics such as home automation, grid optimization...

What can we do with computers that is interesting then? 

Well, an apple is an apple and so is a banana.

Do all the fresh products from a country needs to physically go to a centralized market to then be moved again near their production region?


In 2016, an apple may have to do a 2000km hook to be provided in the market near you. Stupefying.

But actually, it requires no computers, just that producers and consumers see their interest in having a decentralized market and putting in common efforts on logistics. And also ... funding. But, well is it in the interest of people who have the funds to disrupt the market if they benefit from the situation?


If your bank have the account of one of the great distributor will they give you money to potentially make them be poorer? Especially that you might want to incentivize your stake holders by giving more return hence resulting in thinning your assets on your bank account? Capitalism do not favor neither competition, nor liberalism.


So according to the desperate person trying to find me an opportunity as a coder that would be happy with me taking hot showers and offering a decent place to my wife, I have to put some water in my wine and to silence myself in front of my future employers.  They do not need to know.

Either I live by the rules or will live miserable with my ethic, because, that is not how the world works. (I have no ethics, just a big mouth to be honest).

The problem, is I know what I am doing. And I do know that the one who as the money makes the rules, and I have work force and knowledge and no capitals. And there are other coders with the same knowledge on the market.

I am not pleased that 90% of coding offers are related to unethical purposes.  I am not pleased people point finger at me as a coder for it. I am not part of the problem.

It is not me who is unethical. It is the society in which I live that consistently consider we should not voice our concerns because else we may call an evil such as Trump, Le Pen, UKIP, Putin... ruling the country. I will not let fear rule my life.


My blog is critic and people might think: shut it down, it makes you lose opportunity what are you searching for? A hot place to live in or feeling proud of yourself when you wake up?

Well, I have only one life on earth. I will not endure a life of moral pain hoping to be rewarded in the afterlife. I take this life to live plainly my life as a full human being living happily ever after even if it requires a little more efforts than just abiding to the rules blindly.

I am no sheep, I have a spine, and can carry a project to its end thanks to this and that is why I can make interesting code. That is the price to pay. No spine, no interesting code.

And yes, I am concerned when reading my thousands of job offers per week about the use made of the global pool or coders. We are clearly using coding in a more than questionable way. But, once again, chacun sa graisse and this in not mine, me I still want to take hot shower, and am satisfied to have a wife that prefers me when I am who I am.

She loves me this way and that is contributing a lot to my happiness and I just live without questioning myself that much, pretending to be ethical, while I am just socially inept with a big mouth. And to be honest: I don't care about what can happen tomorrow.

Plus qu'un revenu universel, on a besoin d'un droit à commercer et produire universel

Vous vous êtes vous déjà retrouvé pauvre avec des savoirs faire ou une capacité à produire en vous disant, comment je pourrais m'en sortir autrement qu'en demandant les minimas sociaux?

La réponse est simple : vous ne pouvez pas.

La première des choses, c'est le travail. Parfois votre métier qui est supposé bien payé n'a pas d'offres sur la région en cours. Et tous les métiers ne sont pas sur des zolis sites webs simple.

Et, pour ajouter l'insulte à l'injure, pole emploi vous bloque sur tous les métiers où vous n'avez pas une expérience professionnelle. Autrement dit, vous êtes dans une nasse. On parle de «marché du travail». Mais sur un vrai marché, on peut déambuler et voir les étales pleines et vides et se concentrer sur les bonnes affaires. Sur le marché du travail, l'approche en mode crevard ne marche pas ; il est impossible de savoir où la demande est si forte qu'on peut tenter sa chance.

Alors, on pense à se mettre à son compte. Il y a bien le statut d'auto-entrepreneur, mais, il requiert les avances de trésorerie car -expérience d'ancien freelance ruiné- quand un client te paie pas, tu es dans la merde.

Puis on regarde : son pain, son cidre, ses salaisons ses vélos bien réparés et ses lauriers sauce pour lesquels on peut vendre TTC à la moitié du prix marché, et on se dit : si seulement je pouvais vendre ma production ou mes savoir faire.

Puis on se renseigne. Registre des Métiers et Chambre de Commerce, deux instituts moyenâgeux vont requérir de vous le respect de régulation entraînant soit un investissement en temps non nul  (formation réglementée), soit en capital.

On aimerait juste poser une table, mettre ses produits dessus et les vendre. Mais en fait, à moins de payer pour une place sur un marché, ou d'être proprio d'un pas de porte/échoppe vas-y vendre. Si tu es pas un migrant SDF, l'amende pour la vente à la sauvette est dissuasive. 3 750€ et 6 mois d'emprisonnement. Plus que pour envoyer un bourre pif à un inconnu dans la rue. Sérieux la France? Révise tes priorités.

De toute façon avec nos compteurs intelligents, dès qu'un tableau électrique trafiqué par les aïeux pour pouvoir consommer décemment de la puissance afin de faire une consommation énergétique permettant de produire linky pète une coche et te dit d'aller te faire voire; seule une production manuelle est autorisée.
C'est pour éviter les incendies ou pour éviter que les gens puissent produire cette limitation à 10A par foyer? Et je parle même pas de cette TVA à 19.6%, car de toute façon, la grande distribution qui inonde le marché des biens nous encule à sec. J'ai du mal à comprendre comment mon boulanger touche de la bonne farine de blé dur type 110 à .3€ le kg HT est que je suis sensé acheter la même à 3.5€HT/kg. Pourtant, je peux produire du pain au levain à 2.5€ et faire des bénéfs.

J'aimerais pourtant assumer financièrement et légalement ma responsabilité de producteur et payer ses taxes, mais c'est juste une tuerie réglementaire.

Vous me direz, collecte de TVA, protection du consommateur, paiement des charges, ce serait de la concurrence déloyale si tu t'installais sans t'y soumettre. Et je suis bien d'accord.

De fait, la France entraîne une noyade à précarisation.

L'expression consacrée est trappe à chômage, mais la parlons de noyage organisé. Dans la vraie vie, vous devriez vivre avec les queues que l'on sent organisées dans les services sociaux et à la préfecture pour les étrangers, vous auriez l'impression que l'on cherche à vous décourager.

Changer une adresse? 1 courrier, 10 jours d'attentes, 1 heure de queues, repartir, aller refaire la queue à la CCASS car on décrouvre un bug, tomber sur un ancien pote qui est maintenant chef de projet pour les logiciels du gouvernement qui vous dit que les sites sont mal faits pour s'adapter à l'idiotie des utilisateurs ... Putain, mais imagniez qu'avec ça que je suis toujours pas capable d'avoir accès à la CAF depuis 2 mois que j'ai changé mon adresse, et que ma femme attend un numéro de sécurité sociale depuis 9 mois pour pouvoir travailler, que l'on doit se péter les queues de seulement 1 h le matin car on se réveille à 7h avec les putains de marmots qui vous vrillent les tympans et se voir doubler par les resquilleurs car bon, ces gens ont l'air dangereux, vois tu.

En plus, t'es un demi citoyen qui se voit refuser par pole emploi autre chose que des formations gadgets pour des technos dans lesquelles tu crois pas car le marché est déjà hyper saturé en main d'oeuvre à pas cher. Tu as une palanquée de fonctionnaires et des applications androids pour tout, mais 0, nada, aucune putain d'information ou accès direct aux offres d'emplois. Je suis content d'avoir pu faire déménageur parce que mon boss avait mis son numéro de téléphone à la place d'un contact pole emploi.

J'ai parlé à d'autres amis, en retour d'expatriation ; on le vit tous mal. On tombe souvent tous le temps que notre situation administrative retourne à la normale dans une précarisation temporaire qui souvent dure un an. Avec le souvenir d'autres pays où cela ne se passe pas comme ça.


Un an à partager le sort des damnés de l'administration, des assistés car on a pas le choix. On n'a pas le droit de s'aider nous même en commerçant, produisant.

Donc, voilà, je sais produire, je sais faire. Je suis manuel autant qu'intello car on l'est tous. J'ai des opportunités qui me permettraient de contribuer positivement à la société, mais je suis barré, un triquard de la bonne société à cause de toutes ses réglementations qui me pètent le cul, et en plus je dois subir l'humiliation hebdomadaire de passer au travers des mailles dysfonctionnelles de l'administration qui semblent ingénier à cette fin.

Et ça, quand je rencontre le monde des gens politisés, ou de l'éducation, ou des intellos, c'est à dire de ceux qui pensent avoir vocation ou qui se pensent légitime pour exprimer la voix du peuple, je me fais traiter de troll en mode provocation. Et l'énervement aidant, je leur dit de sucer ma bite. Il y a rien de pire que la censure par l'argument autorisé de ceux qui ne savent rien qui te censurent au nom de l'argument ultime en France ton discours fait le jeu du FN. Le cachez moi ce sein que je ne saurais voir des notables: la précarisation.

J'imagine que la pauvreté galopante dois mettre un sacré paquet de personne dans ma situation. J'imagine aussi que l'impression de vivre dans une société qui n'es pas en empathie avec nos douleurs, voire que l'on est systématiquement pointé du doigt par les braves gens et ignorés par les politiques ne donnera rien de bon.


Je fais parti de ceux qui ont une carte électorale et refuse de voter pour délégitimer le système. Je refuse de choisir parmi des politiques qui par structure des élections ne peuvent avoir aucune chance de gagner quand ils représentent mon point de vue. Les élections sont toujours un piège à con. Il devrait y avoir des députés des sommes de minorités qui ne peuvent être majoritaires dans un département.

Des députés qui quand Traore meurent mettent sur le tapis le problème du contrôle au faciès, et non vilipendent «les jeunes des quartiers sensibles». Ils devraient y avoir des députés qui représentent les pauvres, et les «assistés». Des députés qui représentent les «élèves» qui ont peut être aussi leurs mots à dire sur l'éducation .... on devrait avoir des députés qui portent autre choses que des tailleurs et des costards cravates, et qui proposent que l'on déchoient de leur nationalité tous les gens qui fraudent le fisc.

Donc voilà, il fait pas bon en France avoir entrepris. Pour que le goût de l'entreprenariat existe, il faut non seulement une juste rémunération du risque, mais pour chaque personne qui réussit il faut se souvenir qu'autant sinon plus échouent. Qu'échouer est un apprentissage souvent nécessaire. Et que pour avoir de meilleurs entrepreneurs il faut qu'ils puissent remonter en selle, sans peur, retenter et continuer jusqu'à 3 fois comme cela se fait dans d'autres pays. Il n'y a rien de honteux à être ruiné ou pauvre.

Je n'ai pas honte d'avoir échouer. Je n'ai pas honte car les tribunaux consulaire, le RSI, et d'autres y ont bien contribué. Mais, ils ne me font plus peurs. Et je n'ai pas honte de vouloir reprendre une activité économique quel qu’elle soit. Et je préférerais au système d'assistanat humiliant actuel un système d’entreprenariat systématique qui ferait péter la grande distribution, la moitié des artisans, commerçants, propriétaires installés et qui ferait chuter les prix par 2 et nous permettrait à tous d'être nos propres patrons en concurrence loyale avec les gros tout en améliorant nos vies et ouvrant réellement le monde à l'innovation.

Dans un système libéral, le droit de commercer et de produire pour tous les citoyens devrait être inscrit dans la Constitution avec un niveau supérieur au droit sacré de la propriété qui elle ne fait que renforcer les inégalités car c'est l'innovation plus que la reproduction sociale qu'il faut valoriser dans un contexte incertain. 

Indexation textuelle pour trouver le bon job dans la meule de foin des annonces merdiques

Aujourd'hui, il est temps de faire son google.

Mon problème:

Après avoir manuellement recherché parmi des centaines d'annonces et essuyé moult déconvenues je me suis aperçu que la méthode manuelle n'étaient pas bonnes:

  1. chaque entrevue me coûte cher;
  2. la plupart des annonces qui sont à chier sont prévisiblement à chier;
  3. il existe des vraies annonces utiles MAIS les critères de recherches (date, pertinence, lieu) ne sont ni pertinents, ni ceux qui me conviennent et je dois prioriser ma recherche;
  4. je veux bien coder, mais ni pour une SSII, ni pour une startup, ni pour une boîte d'IT ni passer par un cabinet de recrutement (95% des annonces);
  5. je veux pouvoir postuler à des jobs de survie sur lesquels ses enfoirés de pôle emploi ne peuvent me bloquer (débutant accepté, pas de spécificité sur les formations...) et sans contact de pole emploi;
  6. J'en ai assez alors que c'est écrit sur mon CV de passer une entrevue et à la fin devoir expliquer à mon futur employeur que NON je ne dépasserais pas les 48heures hebdomadaires de travail sans que ce soit exceptionnel et rémunéré comme il se doit.
Il me faut donc un moteur de recherche qui a les spécificité suivantes :

  • indexation textuelle pour repérer sur un corpus d'apprentissage les catégories;
  • mesures et fitness des résultats comparé aux objectif;
  • parsing et analyse textuelle des annonces;
  • analyse de méta données pour le filtrage.

Cet article est un rapide survol de géométrie euclidienne en base incomplète sur les données textuelles, car il va falloir trier qualitativement ce que je veux ou non.

Stemmisation, tokenisation


Prenons une annonce classique :

Nous recherchons -pour les besoins d'une société en plein essor- un petit jeune passionné, plein d'entrain, pour travailler dans un domaine intellectuellement stimulant.

Nous allons vouloir comparer cette exemple classique de texte qui pue l'exploitation en startup avec les équivalents. Pour cela, il nous faut nettoyer le texte de 2 choses : le bruit, et les variations.

La stemmisation-tokenisation consiste à découper le texte en un tableau de mots sous leur forme invariante. Les spécialistes de l'indexation textuelle rajoutent au passage un filtrage de mots. Internet fourmille de tuto .... pour l'anglais, mais pour le français c'est bonbon, en plus leur jargon est à chier.

Comprenons bien les 2 problèmes spécifique du français :
  • les mots à virer (stopwords) ne sont pas les mêmes qu'en anglais;
  • les formes invariantes ne se créent pas de la même manière qu'en anglais.
Il faut donc sachant que c'est une partie mineure du travail utiliser mes connaissances de mon premier boulot de SSII à l'ECAM (IBM) pour retirer d'internet la substantifique moelle du jargon pour en tirer un exemple utilisable. 

Tokenisation: découper à la scie propre les mots dans une phrase en faisant attention aux apostrophes, virgules
Stemmisation: réduire les ambiguités liés aux variance de graphie (va, allez, aller, allions == aller; évoluant, évolue, évolution == évoluer)
filtrage des Stop words: virer les mots outils qui font du bruit (le, la, les, un)

Tout ce qui fait que les spécialistes sont payés chers et qui fait le jus de leur boulot n'est pas l'appel aux APIs mais la connaissance des 3 étages qui vont bien.

Des tokenisateurs il y en a des centaines, des corpus de mot-outils aussi, ainsi bien évidemment que des stemmers. Leurs beurres qu'ils mettent dans les épinards de leur expertise payées par des fonds publics consiste à vous dire comment faire dans les grandes lignes, partager le code, mais pas les données spécifiques.

Donc, la première tâche consiste avec un moteur de recherche et une bonne patience ainsi qu'une console python à expérimenter sur les différentes recherches sur stopwords, stemmisation, tokenisation à avoir un ensemble de réglages relativement sain sur ses 3 axes. Il se trouve que python a la librairie pour l'indexation textuelle : nltk

Donc pour référence futur voici le résultat:

Comme les universitaires sont jaloux de ne pas tout vous donner il y a de la magie à faire


    import nltk
    nltk.download()




Ensuite un petit tour au fond du code source nous apprend que c'est magiquement utilisé dans notre dos (ah! j'aime la magie) par la bibliothèque:

cf http://www.nltk.org/_modules/nltk/tokenize.html

Oh! Et Wut?  http://www.nltk.org/howto/data.html

On exécute des pickle arbitraires pour avoir accès aux données? Wut, Wut, WTF!

  1. cela veut dire que nltk est certes open source mais que tout le code qui a de la valeur est lui sous une forme binaire ! Donc, a proprement parlé c'est plus du code proprio (mis à disposition par des universités bien souvent publiques, bien souvent payées par les impôts);
  2. que c'est un putain de trou de sécu. 
Bon, je toussote, et continue.

J'avais prévu de donner les liens vers les docs et les mots clés. Mes différents essais m'ont convaincu que les spécialistes de l'indexation textuelle sont au mieux des fraudes publiques, au pire des petits rats universitaires qui restent dans l'ombre de leurs labos et font tout pour ne pas partager leurs données.

Après trop d'heures passer à tenter d'avoir un compteur de mot décent en essai erreur où j'ai pu me rendre compte que finalement je faisais naïvement mieux que des trucs de pros, je me suis dit fuck off : mets juste ton code à dispo et répond aux commentaires si les gens ont des questions.


Prochain épisode, le Xhi², le machine learning me fait chier, et je parie que je peux obtenir 80% du résultat avec .5% de la puissance de calcul utilisé par les grands groupes pour faire de l'apprentissage en utilisant un poil de géométrie.

Darth Vador programming on its way.